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A non-experimental design was used to determine if 
scores of students enrolled in specified majcr coaching schools were 
siqnif icantly higher than scores of comparable uncoached groups. 
Icore increales at two Scholastic Aptitude Test (SAT) coaching 
schclls and Law School Admission Test (LSAT) schools were compared. 
Over 1,400 SAl examinees and 31,000 LSAT examinees, administered 
"Jese tests between 1974 and 1977, were involved. Comparisons were 
repcrted by study subgroup: uncoached first-tiae examinees; coached 
first-time examinees; uncoached second-time examinees; second-time 
oxaminees coached berore the first test; and seccnd-time examinees 
coached between test adrinistrations. Results indicated that coaching 
was significantly effective in raising SAI scores. LSAT coaching was 
•arainallv effective, possibly because of the abnormally large- 
"S?iol g?cup increases and tL relatively l-.-'^-l-^tl^radr'" 
grade pcint average and LSAT scores- However, the Federal Tr^de 
commission acknowledges that there are "several major flaws in the 
data atalysis, making the results unreliable." (The history of both 
tests, an analysis of coaching research; a description of sales, 
tuition costs, and claims of major coaching scaccls; extensive graphs 
of teS? score data; and case histories nt 17 coached LSAT examinees 
are included). (CP) 



♦♦♦♦*♦♦*♦*♦♦*♦**♦♦*♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦*♦**♦*♦♦****♦♦*♦**♦*♦♦♦♦♦♦*********** 

♦ Betroductions supplied by EDBS are the test that can be made ♦ 

* from the original document. ' 
♦♦♦♦♦♦♦♦♦♦♦**♦♦***♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦***♦****♦♦♦♦♦♦*♦*♦**************** 



ERIC 



us OEPARTMENTOF HEALTH. 
EDUCATION & WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

THIS OOCUVENT HAS BEEN »EP»0- 
OUCEO EXACTLY AS RECEIVED ^^Of^ 
THE PERSON 0» 0»OANJZaTiON 0»»&»N. 
ATtNG IT POINTSOF V r E A □» DPI N iDnS 

tfrVPTnp TO RECIPIENTS OF THE stated do not necessarily »ep»e. 

nV/J^V^C SENT OFFICIAL NATIONAL institute of 

BOSTC»J REGIONAL OFFICE REPORT ON THE education pos>t.on o» poljcy 
EFFECTS OF COACHING ON STANDARDIZED ADMISSION EXAM. 



The attiachee "Staff Memorandum on the Effects of Coaching on 
Standardized Admission Examinations," prepared by the Boston Regional 
Office of the Federal Trade Commission, has several major flaws in the 
data analysis, making the results unreliable. Brief explanations of 
each of the major flaws are described below. 

In this report standardized exam scores (Scholastic Aptitutde Test, 
or SAT, and Law School Admission Test, or LSAT) are compared for groups 
of coached and uncoached students without controlling for differences 
which may exist in personal and demographic characteristics of the 
students in the two groups. Subsequent analysis has determined that there 
are important differences between the coached and uncoached groups, making 
it in^ssible to attribute any observed differences in SAT scores to 
coaching. 

To illustrate, students who are coached for the SAT have, on average, 
higher grades than students who are not coached. It is not possiole to 
know, without controlling for grad-^, if SAT score differences between 
the two groups are due to coaching or to the differences in ability 
reflected in such factors as past school performance. 

In addition to failing to use the data available to control for 
differences in personal and demographic characteristics of the students, 
the results reported cannot >-e evaluated because the report fails to 
provide tests of statistical significance which are necessary to interpret 
the results. Because the report fails to provide these important statistics, 
one cannot determine if the results reported are meaningful or are 
merely due to chance. 

Another defect in the report concerns the method used to present 
the findings from the data analysis. This is especially true for Uie 
analysis of the LSAT performance. In that section of the report, the 
analytical technique employed is misused, causing flaws in the presentation 
of the results. For example, in a number of places, findings are presented 
for students who have a grade point average of 1.0 (a D average). 
Because there are no such students in the sample, it is not legitimate 
to predict the behavior of this class of students. Moreover, because 
virtually no students with a D average would ever take the LSAT exam, it 
is inappropriate to discuss the findings interms of this group instead 
of in terms of students with more typical grade point averages. 

Finally, this study utilized a nonexperimental design. Therefore 
all the limitations associated with this type of study apply to this 
report. 
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I. SUMMARY 

It is the established policy of the United States to 

provide equal educational opportunities for all citizens. 

Rcoqnizing that the Nation's economic, political, and 
social security require a well-educated citizenry, the 
Congress (1) reaffirms, as a matter of high priority, 
the Nation's goal of equal educational opportunity, end 
(2) declares it to be the policy of the United States 
of America that every citizen is entitled to an educa- 
tion to meet his or her full potential without financial 
barriers.^/ 

The present investigation discloses that standardized 
examinations which are utilized as important decision making 
elements in the admission process to undergraduate and 
graduate colleges and universities are susceptible to the 
short-term preparation (often called coaching) offered by 
numerous commercial entities throughout the United States. 

Analysis reveals that there is a statistically signifi- 
cant difference between the score increases obtained by 
coached and uncoached individuals. (However, the score in- 
creases are variable both between and within examinations.) 
Even more importantly, score increases resulting from coaching 
have a practical, educationally meaningful, effect in that 
coaching can be the determining factor in deciding who is 
admitted to undergraduate and graduate colleges and univer- 
sities. The availability of coaching is positively correlated 



1/ General Education Provisions Act, 20 U.S.C.A §1221-1 
(1978). 
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to the ability to pay the tuition at eoachln, schools, which 
can be as high as S250. Therefore co.chable stana.rdized 
admission examinations create financial barriers to educa- 
tional opportunities In direct conflict with our Congression- 
ally declared national education policy. 

The commercial test preparation schools do not perform 
uniformly. Some are quite beneficial while others appear to 
provide marginal benefits. Moreover, the coaching schools 
have a universal propensity for engaging in making unsub- 
stantiated advertising claims, in some Instances making false 
and deceptive advertising claims, and engaging In other unfair 
and deceptive marketing practices, all In violation of Section 
5 of the Federal Trade Commission Act. 

Nonethelecs the existence of only one coaching school 
(and there is more than one) that can materially increase 
individuals- scores on standardized admission examinations 
such as th. scholastic Aptitude Test and the Law School Admis- 
sion Test reveals the lack of reliability and validity of 
these examinations. The test makers themselves tell us that 
standardized admission examinations should be used to help 
predict the academic performance of an individual in under- 
,radu.te or graduate school. Yet, since short-t.r» prepara- 
tion can increase scores, but has a questionable long-term 

^ ^..lipHue value of the standardized exam- 
effect, the true predictive voiuc 

Inations is suspect. 
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The standardired admission examinations are discrimina- 
tory in a number of ways. They discriminate against any indi- 
vidual who either: (1) can not afford the cost of commercial 
preparation or (2) elects not to attend a commercial prepara- 
tion course even if he can afford it because of acceptance of 
' i^e dogma promulgated by the test makers, test administrators, 
and test users over the past twenty years that coaching is 
valueless. 

The examination?? appear to discriminate on the basis of 
race. Certain sub-populations may receive a lesser benefit 
from coaching than others. (However as grade point average 
approaches the maximum there is an apparent inverse effect as 
minorities show slightly greater score increases due to 
coaching.) This result may be attributed to the failure of 
coaching schools to develop materials and techniques aimed at 
these groups or it may be a manifestation of an inherent bias 
in the examinations themselves. Whatever the cause, the 
effect is to put minorities with low grade point averages at 
a greater disadvantage in the quest for positions In our 
schools of higher education by widening the already existing 
score abyss. 

The economic and social benefits flowing from admission 
to undergraduate and graduate colleges and universities 



(especially the more prestigious) are axiomatic. The suscepti- 
bility of standardized examinations to coaching, the unavaila- 
bility of coaching to all on an equal basis, the discriminatory 
effects befalling some groups who benefit less from coaching 
than others, and the failure to rectify this situation, con- 
stitute violations of Section 5 of the Federal Trade Commis- 
sion Act or are indicia of serious flaws in both the post 
secondary school admission process and in our national edu- 
cation system. 

Accordingly, we propose for Commission consideration 
some or all of the following remedial actions to alleviate 
or eliminate the unfair and deceptive acts or practices 
we have discovered: 

(a) Publication of either - staff report or formal 
Section 6(f) report to Congress? 

(b) Initia-aon of formal investigations of the Educational 
Testing Service, College Entrance Examination Board, Law 
School Admission Council, and American Bar Association 
(These investigations would seek to ascertain the 

extent of our jurisdiction over the investigated parties 
and we would simultaneously seek to negotiate consent 
agreements. Complaint recommendations, if appropriate 
and necessary, would follow these investigations); 

(c) Additional studies to supplement the statistical 
analysis we have completed and which ultimately would 
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lead to an attempt to create uncoachable, more valid 
and reliable standardized admission examinations; 
(d) Initiation of a trade regulation rule proceeding 
r«igarding the coaching school industry or alternatively 
individual litigation against the coaching school with 
the most egregious violations of Section 5. 

These and other alternatives are explained in greater detail 

in the recommendations section, infra . 

II. INTRODUCTION 
On October 13, 1976, the Federal Trade Commission issued 

a resolution authorizing and directing its Boston Regional 

Office (BRO) to conduct an investigation: 

To determine whether or not various examination and test 
preparers, review courses, coaching schools and other 
persons, partnerships, or corporations, may have been, 
or may now be engaged in unfair or deceptive acts and 
practices in or affecting commerce in violation of Sec- 
tion 5 of the Federal Trade Commission Act, as amended, 
including but not limited to false, misleading and de- 
ceptive advertising, non-disclosure of material facts, 
unfair and deceptive point of sale misrepresentations, 
and other unfair or deceptive acts and practices in 
connection with the advertising, offering for sale, sale 
and distribution of the services and products of various 
test preparers, review courses, and coaching schools. 
The investigation is also intended to determine whether 
Commission action to obtain consumer redress woul,^ be 
in the public interest. 2/ 



2/ See Category I File 772 3000, Vol. I, p. 1. 
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An PTC ne^s release dated November 2r 1976 publicly 

announcing the investigation indicated that the investigation 

would be designed to provide insight into such issues as: 

. whether test preparation centers have had or now have a 
reasonable basis for claims of score increases at the 
time such claims were or are made; 

. whether test preparation centers have the capacity to 
increase or maximize pcores on certain standardized 
tests that are often prerequisites to admission to 
undergraduate or graduate colleges^ universities^ pro- 
fessional schools or professions; 

. whether test preparation centers have the capacity to 
increase scores on certain standardized tests to the 
degree advertised; 

. whether test preparation centers are engaged in unfair 
or deceptive point-of-sale practices; and 

. whether Commission action to obtain consumer redress 
would be in the public interest. 

Prior to commencing the nationwide investigation announced 
in the November 2r 1976 press release, staff had been investi- 
gating the Stanley H. Kaplan Educational Center, Ltd. (File No. 
762-3033). V After much cerebration and consul'^ation with 
experts in the field V staff concluded that a national in- 



3/ See Category III File 772 3000, Vol. I, p. 88. 

4/ The investigation of the Kaplan organization formally 
^ commenced on August IB, 1975. Its original premise was 
that Kaplan could not substantiate certain advertising 
claims at the time they were made and accordingly had 
violated Pfizer , 81 FTC 23 (1972). 

5/ See Category III File 762 3033, Vol. I, p. 83-84, 100-101; 
^ Category I File 772 3000, Vol. I, p. 47-48; Category I 
File 772 3000, Vol. II, p. 1-2, 14-16, 34-39. 
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vestigation of the test preparation industry would be far 
more" cost efficient and better serve the public interest 
than an investigation of only one coaching school .6/ The 
investigation of Stanley H. Kaplan Educational Center, 
Ltd.r although retaining its own 7-'3igit number has therefore 
been incorporated into the industrywide inquiry. 
Ill . A HISTORi OF THE SCHOLASTIC APTITUDE TEST (SAT) , THE LAW 
SCHOOL ADMISSION TEST (LSAT) , THEIR USES BY COLLEGES , 
LAW SCHOOLS , AND OTHERS 
The SAT, LSAT and other standardized admission examina- 
tions are intermediate predictors. They do not purport to 
measure how an individual will perform in a given profession 
or field. Instead it is suggested by the administrators 
of these examinations that they be used as one criterion in 
predicting how well an individual will perform in the first 

year of academic study. 2/ 

The need for a universal predictor of first year academic 

performance is indicated by; 

(1) the variance in meaning of grades from different 
schools and curricula; 

(2) the inability of admissions offices to cope with 
large numbers of applications on a personal basis; 

6/ See Cat«!gory I Fil< T72 3000, Vol. I, p. 9-10. 

7/ Guide To The Admissions Testing Program , p. 21, CEEB, 
" NY (ISTT)' 
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(3) the Inability of graduate scnools (and some under- 
graduate schools) to expand their enrollments to meet 
demand; and 

(4) the desire to minimize the attrition rate; 

(a) because of the psychological and economic hard- 
ships on students who fail; and 

(b) because of the economic disutility of a high 
attrition rate to academic institutions. 

On November 17, 1900 the College Entrance Examination 
Board (CEEB) officially commenced operations. Seven months 
later 973 students wrote essay examinations on subjects in- 
cluding history, english, mathematics, science, and foreign 
languages. The grades received on those examinations were 
sent to participating colleges to be used as part of the 
admission procedures. By June of 1925 College Board examina- 
tions were being taken by approximately 20,000 candidates. 

In June of 1926, 8,040 candidates for admission to 
college received the first administration of the Scholastic 
Aptitude Test (SAT). The SAT had been dev.'iloped for CEEB 
by Carl B. Brigham, a professor of psychology at Princeton. 
Its initial purpose was to supplement the regular series 
of CEEB examinations. 

As the number of applicants. for admission to colleges 
rapidly rose (excepting a regression during trfe depression) , 
the numbers alone made the essay format of the College Boards 
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impractical. In X946 some 46.000 applicants took the College 
Boards. Although traditionalists grumbled, the multiple- 
choice format of the SAT was a natural substitute. 

In 1947 CEEB. in cooperation with the American Council of 
Education (the Graduate Record Exam) and the Carnegie Founda- 
tion for the Advancement of Teaching (which administered the 
National Teachers Exam), founded the Educational Testing 

Service (ETS). 

ETS' initial client was CEEB. and as a result it 
administered and continues to administer the SAT and college 
achievement tests. Since its inception ETS has diversified 
and now administers, researches, and refines numerous 
standardized admission and vocational examinations including 
the LSAT. GRE, GMAT as well as the SAT and achievement tests. 

Today approximately 1.5 million students per year take 
the SAT. The SAT coupled with ETS' other testing activities 
accounted for about 87% of ETS' $70 million revenue in 
fiscal 1977. 

The specific use to which the SAT has been put in the 
past decade has varied from college to college and from year 
to year. In general the SAT was most important in the 
admission process during the post-Sputnik era when competi- 
tion for college admission became intense. Most colleges 
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responded by raising their standards rather than increasing 
enrollment, and test scores therefore became critical. _8/ 

With decreasing applications and enrollment expansion the 
SAT today is generally less critical in the admission process 
than it was in the 1960's. However it is still crucial for 
those seeking admission to "high prestige" schools. It 
appears that for schools other than, the highly selective the 
SAT is most important at the bottom line. That is, failure 
to obtain a certain minimum score will result in rejection. 
For example the California State University and Colleges 
System requires a minimum combined score of 2500 on the 
SAT plus three achievement tests and a B average. If a student 
fails to attain a 3.1 high school average (B-) the University 
of California/Berkeley requires a minimum combined SAT score of 
1100 plus a minimum score of 1650 on three achievement tests. 
Oregon State University requires a minimum combined SAT score 
of 890 or a high school average of 2.50. Florida State Uni- 
versity requires out of state students to obtain a minimum, 
score of 500 on both the verbal and mathematical sections of 
the SAT whil«^ Florida Technological University requires out of 
state students to have a combined minimum SAT score of 900. 
The University of South Florida requires out of state appli- 

8/ See generally, 2 The Encyclopedia of Education , p. 211 
" -213, The Macmillan Co. and The Free Press 1971; 

Ravitch, The College Boards, The N.Y. Timeg Magazine, 
May 4, 1975, p. 12-22; Science Digest , October 197 6, 
p.39-45; Forbes , November 15, 1976, p. 94. 
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cants to obtain a combined SAT score of 800 with a minimum 
of 400 on the SAT verbal. North Texas State University re- 
quires a minimum combined SAT score of 675 and the University 
cf Mississippi requires a combined minimum SAT score of 680. 

Princeton University, Smith College, Stanford University, 
Wellesley College, Brown University, University of Chicago, 
Yale University, and Massachusetts Institute of Technology, 
among others, all accept freshman classes in which over 90% of 
the admittees score over 500 on both the SAT verbal and SAT 
mathematical sections. 9/ 

As is evidenced by the figures above some universities 
prescribe definitive minimum cutoffs and at others the fail- 
ure to obtain a certain minimum score means almost certain 
rejection. 

In some instances where high schools refuse to send 
grades to colleges or where a high school is relatively un- 
known to a college admissions office the SAT becomes the sole 
criterion for admission. Furthermore New York State has 
substituted the SAT for its traditional Regent's Exam to 
determine scholarship recipients. 10/ 

9/ The sources for SAT score data are Comparative Guide to 
^ American Col leges , Cass & Birnbaum, Harper Row, New York, 
6th Ed." TfTTjand The College Handbook , CEEB, N.Y. 1977. 

10/ See Category III File 772 3000, Vol. I, p. 87. This is 
— an interview report with the Chief of New York State's 
educational testing wherein he states that if coaching 
is only minimally effective it would distort to some 
extent who obtained Regent's scholarships. 

11 
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Generally while the SAT is not as important a factor 
in the admission process as it was several years ago it 
is still a very material factor. A reversion to a national 
attitude sisnilar to that of the early 1960 's would make 
the SAT even more critical in the admission process. 

It appears that the first law aptitude examination was 
offered at Columbia Law School in 1921.11/ Prior to 1948 
at least seven specially constructed legal aptitude tests 
were used by various institutions as one means of selecting 
applicants to their law schools. 12/ In 1925 Merton L. 
Person, Dean of the University of North Carolina Law School^ 
and George Stoddard, Assistant Professor of Psychology and 
Education at the University of Iowa, announced the creation 
of the Ferson-Stoddard Law Aptitude Examination. 13/ The 
Ferson-Stoddard examination was remarkably similar to the 
current day LSAT containing sections on: (1) capacity for 
accurate recall (memory); (2) reading comprehension; (3) 
reasoning by analogy; (4) reasoning by analysis; and (5) 
skill in pure logic. 14/ 

11/ Ramsey, Law School Admissions: Science , Art , or Hunch , 
12 J. Legal Ed. 503 (1960). 

12/ Id. 

13/ Person, Law Aptitude Examinations , 5 Am. L. School Rev. 
563 (1925). 

14/ Stoddard, Person and Stoddard Lay Aptitude Examination 
-Preliminary Report , 6 Am. L. School Rev. 78 (1927) . 
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In 1941 an experimental edition of the \ova '.jqal Apti- 
tude Test appeared. Apparently dissatisfied witb the oxaraina- 
tions available, a group of law schools approached the College 
Entrance Examination Board in 1947 regarding the possibility 
Of producing a national aptitude test for the legal profession. 
The result of these negotiations was the birth of the LShT.lS/ 

The LSAT has grown in importance to the point where as a 
prerequisite to accreditation the American Bar Association 
(ABA) requires law schools to require their applicants to take 
the LSAT. 16/ It is not only the demand of the accrediting 
authorities that makes the LSAT prominent in the admission 
process. Although intensive examination of an applicant's 
educational and life record might well yield more satisfactory 
admission results 17/ most law schools were and are thinly 

15/ See n. 11 at 513, supra. 

16/ "All applicants except those physically incapable of 
— taking it, should be required to take an acceptable 

test for the purpose of determining apparent aptitude 
for law study. A law school that is not using the Law 
School Admission Test administered by the Educational 
Testing Service should establish that it is using an 
acceptable test." ABA Standards for Legal Education, 
Chapter V, Section 503. The American Association of Law 
ScKooH lAALsTntias rrtmilar requirement. In fact there 
is no other test that purports to measure aptitude for 
the study of law. Goolsby, A Study of the Criteria 
for Legal Education and Admission to the Bar , 20 J. 
Legal Ed." 175 (1967) . 
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staffed with admissions personnel .18/ As a result, law 

school admission decisions, excluding special admission 

programs, are based almost exclusively on the numbers. 

Even a vigorous opponent of this conclusion notes: 

At some point of course it does become essentially impos- 
sible for personal factors to compensate for uncompromis- 
ing objective credentials for the over-all correlation of 
LSAT scores and undergraduate grades with law school per- 
formance can raise questions of survival .19/ 

While there is a great diversity in approach the most 

common method used in selecting applicants for admission to 

law school creates an index score by adding the LSAT score to 

a number equal to 200 times the grade point average (Index = 

LSAT + [GPA X 200]). 20/ This procedure attempts to give 

the LSAT and the GPA approximately equal weight in the 

admission decision making process. 



18/ Schmidt, Admissi on to Law Schools ; Not By^ Computer, 
Mot By Chance, 10 Tulsa L.J. Ill (1974). 

19/ Winograd, Law School Admissions , A Different View, 59 
— A.B.A. J. 862, 865 (1973). 

20/ See Category III File 772 3000, Vol. XXXI, p.l83. ; 

Although this information is obtained from a coaching 

school it is highly credible in that the Board of 
Editors consists of professors from Harvard, Loyola, 
Wayne State, University of Illinois, University of 
Texas, and University of Southern California Law Schools 
Ses also Category III File 772 3000, Vol. I, p. 84-86, 
Admissions Practices of Temple Law School; and Pre Law 
Guidebook of Boston College, p. 65, wherein xt is stated 

Almost every law school will weigh certain variables 
within the structure of a specific formula. Many 
law schools multiply their LSAT score times two 
adding this result to your Grade Point Average (GPA) 
and the rating of your undergraduate institution. 
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The importance of the LSAvT score in the admission pro- 
cess can not be undereraphasized. Not only does the LSAT 
share approximately equal weight with the Grade Point Average 
(GPA) but the failure to obtain a rainirauran LSAT cutoff score 
at some law schools means automatic rejection. 21/ While only 
a few law schools admit to having absolute minimum LSAT re- 
quirements others admit to having a "preferred" minimum LSAT 
score. 22/ While the official guide to law schools informs 
us that "Some schools do follow automatic qualifying or dis- 
qualifying credentials such as minimum gradepoint averages 
(GPA) and LSAT scores, but most are not wedded to such cutoff 
scores and averages," 21/ ^ review of that publication indicates 
that the use of a minimum cutoff score is not infrequent. 

For example the following law schools among others did 
not admit any students with LSAT scores below 500 for the 1977 
graduating class (the number in parentheses is the number of 
applicants applying with an L-^AT score below 500): University 
of Denver (196), George Washington University (384), University 
of Illinois (199), University of Kentucky (199), Mercer Univer- 
sity (227), University of Minnesota (82), University of New 
Mexico (187), University of Wisconsin (107). In summary, of 

21/ Lunneborg & Radford, The LSAT ; A Survey of Actual 
— Practice , 18 J. Legal Ed."~r3T3 (T966). 

22/ Idi 

23 / Prelaw Handbook ; AALS, LSAC, ETS (1974). 
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the 1581 applications received by these law schools reporting 
an LSAT score below 500, none were accepted. 

The following law schools also did not accept any appli- 
cants with an LSAT score below 500 except for those students 
admitted pursuant to a special admission or minority program 
(the number in parentheses again reflects the number of appli- 
cants to the institution with LSAT scores below 500): University 
of California/Berkeley (151), University of Colorado (240), 
University of Georgia (272), Marquette University (264), 
University of North Carolina (279), and the University of 
Oregon (96). In summary, of the 1308 applicants reporting an 
LSAT score of below 500, not including those admitted pursuant 
to a special admission program, none were admitted to the 
above-mentioned law schools. 21/ 

The above survey is not exhaustive. Not all law schools 
have furnished data and we could see no benefit at this time in 
attempting to acquire admission standards from every law school 
in the country. We believe it is clear that minimum cutoff 
scores are prevalant. 

Even if it is conceded that law schools are not using a 
minimum cutoff score, it is evident that the use of a formula 
in effect creates a threshold LSAT score that must be sur- 
passed to obtain co/nsideration for acceptance. This becomes 

24/ iii 
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even more evident when it is recognizeu that the range of the 
grade point averages of applicants is narrow (as a result of 
both grade inflation and increased applicant ability) thus 
limiting the grade point average component of the formula to 
a range of about 400 points rather than its theoretical 800 
points . 

The LSAT is being used (abused) for purposes other than 
admission to law school. We have had personal experiences of 
emp-oyers requesting LSAT scores on applications for attorney 
positions. In fact until recently the Commission requested a 
job applicant's LSAT score on the supplemental attorney's form. 
We believe this is a practice that is not uncommon in both the 
public and private sectors. 

IV. REVIEW OF PRIOR RELATED RESEARCH AND LITERATURE 

Considering the imporance of the issue, and the constant 
student and parent request for its resolution, there is a pau- 
city of prior research and lite'-ature concerning the coacha- 
bility of standardized admission examinations. 25/ In fact we 
find virtually no material dealing with the effects of coach- 
ing on any standardized admission examination other than the 
Scholastic Aptitude Test (SAT) and no material at all concerned 

25/ For the most thorough and roost up to date review of this 
— entire area, see Pike, Short - Term Instruction , Testwiseness 
and the Scholastic Aptitude Test : A Literature Review with 
Research Recommendations , Educational Testing Service, 
Princeton, New Jersey, 1978. 
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with the commercial coaching schools as they presently exist. 
He also find no material on the effects of coaching 1-time 
test takers, only test repeaters who have been coached 
in the interim period between test administrations. There 
is however considerable material dealing with the general 
topic of test-wiseness. (TW) . 

Two research reports deal extensively with the current 
state of knowledge of test-wiseness.26/ Test-wiseness has 
been defined as the ability to manifest test taking skills 
which utilize the characteristics and formats of a test and/or 
test taking situation in order to receive a score commensurate 
with the abilities being measured. Alternatively the term has 
been defined as ,a subject's capacity to utilize the character- 
istics and formats of the test and/or the test taking situa- 
tion to receive a high score... and is logically independent of 
the examinee's knowledge of the subject matter for which the 
items are supposedly measures. 

some aspects of test-wiseness include effects of practice 
on tests, familiarization with item types, following instruc- 
tions, using time efficiently, knowing when to guess, not 



26/ see generally. Fond V. , Everything You Wanted To Kngj 
AbL! ?est-Wi4eness, igvTTlfe-DScument Repor^uctxon 
^ervTceTEd" 093 ^12) ; Jongsma, E.A., Wershaver E. , 
?he Effects of Instruction in Test-Making Skill Ufion 

TfTTTErlc Document Reporduction Service #Ed 114 408). 
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hesitating to change an answer , and having a planned strategy 
for answering examination questions* 

Test-wiseness is recognized by most experts as a source 
of variance on educational tests. Moreover it is generally 
agreed that test-wiseness is cognitive. It would then not be 
surprising to find that coaching schools have the capacity to 
increase scores on stnadardized admission examinations, at 
least to the extent that test-wiseness is a score component, 
especially where they are dealing with test-naive students. 

Generally the few prior studies investigating the effects 
of coaching on the Scholastic Aptitude Test have concluded 
that coaching is ineffective. Based on these studies the 
trustees of the College Entrance Examination Board have stated 
that "score gains directly attributable to coaching are of 
such a small magnitude that it is unreasonable to expect 
coaching to affect admissions decisions" . 27 / 

However, a 1972 study conducted by two Educational Test- 
ing Service psychometricians, which was commissioned by the 
College Entrance Examination Board, severely criticizes these 
prior 6tudies*28/ 

27/ College Entrance Examination Board, Effects of Coaching 
on Scholastic Aptitude Test Scores , New York, CEEB, 

T56T. 

28/ Pike L. 6 Evans P. , Effects of Special Instruction ^or 
Three Kinds of Mathematics Aptitude Items , CEEB, New 
York, 1972. 
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The authors state: 

... the particular question of the effects of special 
Instruction on different mathematics item formats is not 
adequately answered by previous research. First, the 
majority of studies were designed to determine whether 
coaching schools gave their clients an unfair advantage 
on the SAT. The instruction provided in these studies 
was, where its nature can be ascertained, rather scanty. 
There appeared to be little or no systematic attempt to 
identify the skills needed to perform well on the test 
and to develop materials to meet these needs. Since 
most previous research on this question involves sub- 
jects at the extremes of the ability range, generaliza- 
tion to the more heterogeneous population of candidates 
currently seeking admission to higher education becomes 
hazardous. 29/ 

The authors also stated that: 

many of these studies were conducted in the 1950 's 
when the SAT candidate population was more homogeneous 
than it is today. Consequently, much of this research 
involved subjects enrolled in private prepatory schools 
or in public schools whose student bodies were well 
above the national average in tested ability. One can 
probably assume that the subjects in these studies ... 
were therefore less likely to benefit from special in- 
struction than were students in the more general popula- 
tion .30/ 

It is also important to note that students were assigned 
to experimental and control groups in some instances without 
regard to their desires to receive coaching, although in other 
instances the assignment was on a voluntary basis. 

The major focus on the 1972 study was to determine if 
a new mathematical question format (quantitative comparisons), 
which the College Board was considering using on the SAT mathe- 
matical section, was susceptible to coaching. As a by-product 

i9/ Id: ' " 

30/ Id. 
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the authors also sought to ascertain if the SAT question types 
then in use, regular math and data sufficiency, were suscep- 
tible to coaching. The authors concluded that "... each of 
the three item formats was susceptible to the special instruc- 
tion directed toward it. "31/ They further stated that, 
-Certainly the gains achieved by the quantitative comparison 
and data sufficiency instructed groups on the appropriate 
items are of practical value. "32/ 

AS a result of these findings the College Board declined 
to use quantitative comparison items on the SAT at that time.33/ 
Nevertheless these item types are found on the Scholastic 
Aptitude Test, Law School Admission Test, Graduate Management 
Admission Test, and Graduate Record Examination today. More- 
over the scholastic Aptitude Test still retains data sufficiency 

and regular math item formats.2i/ 

In a most recent paper Pike 35/ recognized ten components 

of observed SAT test scores: 
31/ Id. 



32/ Id. 
33/ Id. 

14/ See Generally the bulletins prepared for applicants 
— ^ for ItSndardLed examinations by the administrators 

o?tSe Examinations. File 772 3000, Physical Exhibits 

I, J, K, and L. 

35/ See n. 25, supra . 



21 



■True score" components: e.g., verbal aptitude, math 
aptitude. 

1. A composite of underlying knowledge (e.g., vocabu- 
lary, elementary algebra) and reasoning ability, 
developed over a long period of time. (Long-term 
acquisition, long-term retention.) 

2. A state of being well-reviewed, so that the per- 
formance to be demonstrated is in line with the 
individual's underlying developed competence. 
(Short-term acquisition, short or medium-term 
retention. ) 

3 Integrative learning, overlearning, consolidation. 
(Short-term acquisition, long-term retention.) 

4. Learning criterion relevant, analytic skills (e.g.. 
how to identify the main idea of a paragraph; how 
to simplify complex quantitative terms before com- 
paring their value). (Short-term acquisition, 
long-term retention.) 

primary test specific components. 

1. The match between the domain of developed ability 
(including the various score components listed 
in A above) and test content-. Mismatches may occur 
as gaps in such areas as skill in locating infor- 
mation in reading passages and ability to work 
with the algebra of inequalities. 

2 General TW— Test familiarity, pacing, understand- 
ing of general directions, general strategies for 
using partial information, and so on. 

«5necific TW — Components similar to B2, but in 
feference to characteristics of specific item formats 
uSii iSve^bal analogies and quantitative-comparison 
items) and other item characteristics. 

Secondary components influencing test taking. 

1. Level of confidence. 

2 Level of efficiency— The ability to use avail- 
able knowledge and reasoning ability quickly, 
with a relatively low rate of errors resulting 
from working rapidly. 
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D. •Error." Fluctuations in attention, sampling error, 
variations in luck in guessing, etc.J^/ 

Pike concluded that eight of these items (except Al, a 
composite of underlying knowledge, and D, error) were, based 
on his review of prior research, susceptible in varying 
degree and situations to some type of preparation (either 
coaching, short-term instruction, or intermediate term in- 
struction) .37/ 

This is evidence that test preparation services may 
have the capacity to increase scores. Pike stated in considering 
the discrepancy between past studies on coaching that "... 
in principle a single study showing substantial positive 
gains cannot be countered or refuted by any number of studies 
failing to get positive results. "38/ 

V. INVESTIGATIVE METHODOLOGY 
Test preparation services are those commercial 39/ enter- 
prises that in a relatively short time, by employing a variety 
of methods, attempt to aid an individual to increase his/her 
scores on standardized examinations that are often pre- 
requisites for admission to undergraduate and graduate colleges 



36/ Id. at 3-4. 
37/ Id. at 38-42. 
38/ Id. at 35. 

39/ See our comments on the non-profit segment, 
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and universities, 40/ Their intensive programs are directed 
specifically towards the examination that an individual is 
preparing to take and any residual long-lasting benefits 
that may result are purely secondary. The terms "review 
course", "coaching school" and "cram course" are synonymous 
with and used interchangeably with the term "test preparation 
service". Our initial investigatory tasks were to identify 
these organizations and ascertain the nature and szcucture of 
the test preparation industry, 

Survviys cf the Education and Career Development Directory 
of the, Nfcv York Times 41 / and the education sections of other 
national Sunday newspapers proved fruitful in identifying in- 
dustry members. Once an industry member was identified it was 
invariably asked to identify its competitors. We also closely 
scrutinized the telephone directory listings under tutoring 
and coaching, and visited numerous campuses to view any adver- 
tisemeiits appearing in college newspapers or posters placed on 
bulletin boards by coaching schools. Needless to say we 
asked students if they had any knowledge of who was offer- 
ing coaching courses, 

40/ This definition is similar to that chosen by the 
— College Entrance Examination Board (CEEB) to define 
coaching. See, Effects of Coaching on Scholastic 
Aptitude Test Scores , CEEB, N,y, (l9?T) p,4, 

41/ See Category III File 772 3000, Physical Exhibit iW 
p. 50-51, 
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Perhaps our most successful technique for identifying 
industry members was to mail four hundred thirty-two (432) 
questionnaires 42/ to pre-law advisors in universities in the 
metropolitan areas of Boston, MA; Chicago, IL; Los Angeles, 
CA; and New York, NY.43/ We received 185 responses to 
these questionnaires (42.8%) and 69 responses named either 
an individual, commercial enterprise, or not-for-profit organi- 
zation that was offering or had offered test preparation. 

Our previously acquired knowledge of the industry alerted 
us at the outset to the impossibility of identifying every 
industry member in the United States. Accordingly we decided 
to focus on major metropolitan areas that have a large number 
of universities, a high student population, and a high number 
of coaching schools. 

Stanley H. Kaplan Educational Centers, Ltd., the largest 
coaching school in the industry in terms of annual revenues as 
well OS total number of students taught, informed us that its 

42/ These questionnaires were mailed after receiving clear- 
ance from the General Accounting Office as required by 
the Federal Reports Act, 44 U.S.C. SS3501 - 3511. See 
Category I File 772 3000, Vol. I, p. 49-59. 

43/ The pre-law advisors were selected by reviewing Directo- 
^ r ies of colleges from California, Illinois, Massachusetts 
and New York. These directories are incorporated in 
File 772 3000 as Physical Exhibits M, N, O, and P re- 
spectively. The responses to these questionnaires are in 
corporated in Category III File 772 3000, Vols. IV - VI. 
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largest- centers were located in the metropolitan areas of 
Boston, Chicago, Los Angeles, and New York. We also de- 
termined that all the national coaching schools operated in 
at least one of these crties. We therefore decided to limit 
our initial inquiries to these four metropolitan locations. We 
have since decided that close scrutiny of other geographical 
locations is unnecessary at this time. The statistical 
analysis that we have performed and its conclusions can be 
validly used to draw parallel inferences concerning the entire 
nation. 44/ 

We also decided to limit our investigation in time to the 
period from October 1974 through December .1976 inclusive. 
This decision was based on several factors. The number of 
students coached in this period gave us large sample sizes 
which is beneficial to the accuracy of a statistical inquiry. 
The record retention of the coaching schools deteriorates 
rapidly prior to that period and identification of now defunct 
entities that existed prior to October 1974 is extremely dif- 
ficult. Data maintenance for a greater time period and more 

44/ In fact, this is what the mathematical discipline of 

statistics is all about. Statistics is the science of 
• inferring generclities from specific observations. Al- 
though we never know for sure in any particular case 
Whether a hypothesis is true or false the P^-o^^f""^ 
statistical inference make it possible for us to state 
precisely what the probabilities are that we will accept 
a false hypothesis or reject a true hypothesis. This 
statistical proof is the basic form of proof used in 
the investigations of all sciences. 
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extensive geographical locations becomes extremely cumbersome 
and costly as time frame or geographical location is increased. 

Not only have we limited our specific inquiry to time 
and location but we have also limited it, for the purpose of 
testing the effectiveness of coaching and the truth or falsity 
of coaching school claims, to two standardized examinations: 
the Scholastic Aptitude Test (SAT), and the Law School Admission 
Test (LSAT). The justification for the limitation of the 
specif ic -inquiry to these two examinations is the same as that 
for limiting the specific inquiry to four geographical loca- 
tions — viz. we believe valid inferences about the coacha- 
bility of other examinations can be drawn from the specific 
results we obtain for the SAT and LSAT, or at the very least 
place a strong burden on the parties to whom any inferences 
are adverse. Furthermore, the SAT and LSAT are the two most 
heavily coached examinations administered by the Educational 
Testing Service and therefore we have had less difficulty in 
developing a significant data base for their analysis than we 
would have for other examinations. 

One further limitation on our specific inquiry must be 
noted. It came to our attention that there are many high 
school teachers and others coaching high school students for 
the SAT. For practical reasons (time and resources) it Is not 
possible to ferret out all these individual entrepreneurs and 
we have not attempted to do so. This fact coupled with the 
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extremely extensive and voluminous SAT computer files main- 
tained by the Educational Testing Service caused us to de^ 
cide to limit the specific SAT inquiry to major coaching 
schools in the metropolitan New York City area. The failure 
of some of these organizations to maintain any records, 
legible records, or to have taught an appreciable number of 
students during our relevant time frame has reduced our SAT 
statistical analysis to two major SAT coaching schools. 
This limitation in scope of our statistical analysis has not 
affected in any way our industry analysis. Furthermore this 
limitation of our statistical analysis, if it is a bias, dis- 
favors the coaching schools actually analyzed, in that we can 
not be sure that our control groups have been culled of all 
coached students. This and other biases are discussed, infra. 

The statistical analysis to which we have been referring 
was designed to determine the effectiveness of coaching schools. 
As a by-product it also determines the truth or falsity of the 
coaching school claims as well as the truth or falsity of the 
claims of the test makers. It is discussed in more detail, 
infra. 

In order to develop data for computer analysis, enrollment 
forms reflecting coaching school cnrollees had to be matched 
with the ETS' computer tapes. As individual industry members 
were identified they were requested to submit information to 
us pertaining to their operations. The most important 



element requested was the student enrollment or registration 
forms. Although most test preparation services had this data 
in some form their record retention and record legibility was 
not always exemplary. Therefore each of the more than 14,000 
enrollment forms we obtained was inspected for legibility and 
for any apparent inconsistencies or omissions. If for example 
a name was partially illegible we checked the appropriate 
telephone book in an attempt to ascertain the correct name 
spelling. If a street address was omitted we followed the 
same procedure. In literally thousands of instances zip codes 
were omitted from addresses on the enrollment forms and these 
were manually supplied by employing the National Zip Code 
Directory. This procedure resulted in our matching over 80% 
of the coaching school enrollees with individuals on ETS' 
computer tapes. Part of the unmatched percentage can be 
attributed to a failure by the student to actually take the 
SAT or LSAT. 

In order to ascertain the completeness of the coaching 
schools* enrollee records we determined the expected number of 
enrollees by dividing each coaching school's annual income by 
its tuition cost. Although this procedure was unavailable 
in some instances due to integrated financial statements, and 
was approximated in other instances due to tuition fluctuation, 
we conclude that we have acquired over 91% of the total LSAT 
enrollment forms we sought from the coaching schools involved in 
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out statistical analysis and in excess of 99% of the SAT 
enrollnent forms we sought from the coaching schools Involved 
In our statistical analysis. 

Once the enrollment forms had been acquired and any 
Illegibilities or omissions were rectified, the names, ad- 
dresses, and other available identifying information, including 
the dates when the student was coached, contained on the enroll- 
ment forms were typed onto plain bond paper (only students 
attending the same coaching school appeared on the same page 
with a code corresponding to the coaching school where the 
students had been coached appearing on each page). 45/ These 
student enrollment lists were then ready for computer matching 
with the ETS computer tapes and for statistical analysis. 

VI. INDUSTRY STRUCTURE 

It is fundamental to recognize that the economics of the 
coaching school industry is merely a subsidiary consideration 
in ascertaining the public interest of this inquiry. The 
social, psychological and economic benefits that may be 
gained by individuals who attend a coaching school transcend 
the current stature of the coaching school industry. Not- 
withstanding, the following industry analysis is offered. 



45/ This procedure was followed to ensure that ©"nly PTC 
^ personnel could determine which results corresponded 

to which coaching schools until such time as the data 

is publicly released. 
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A. COMMERICAL 

In the metropolitan areas of Boston, Chicago, New York, 
and Los Angeles from October 1974 through December 1976 a 
total of in excess of 15,000 students were commercially 
coached for the SAT and LSAT>46/ We estimate that 50,000 
individuals are being coached annually nationwide for all 
standardized admission examinations. 

For 1975 and 1976 combined, the twenty-one commercial 
entities that we have identified and included in our analysis 
had total annual sales of $9,403, 615. £7/ We estimate that the 
total annual sales volume of all commercial preparatory courses 
nationwide is $10,000,000. 

The twenty-one entities considered here expended $400,000 48 / 
on advertising in 1976. Their tuition ranged in price from a 
maximum of $250 (plus a $50 refundable deposit for materials) 



46/ We have in our possession the names of 11,906 LSAT coachees 
— and 2286 SAT coachees that were obtained for use in this 
study although not all have been used. All SAT coachees 
are from the metropolitan New York City area. 

47/ This figure includes revenues obtained from all standard- 
~ ized admission tests, not only the SAT and LSAT. 

48/ Since the coaching schools are advertising in effect to 
a captured audience they can reach all potential enroll- 
ees by using low cost techniques such as posters and 
school newspapers. The Stanley H. Kaplan Educational Center 
estimates 80% of its students attend due to referrals not 
advertisements. See, Transcript of Investigational Hear- 
ing of Stanley H. Kaplan, dated May 6, 1976, p. 40. Al- 
though many coaching schools advertise in large newspapers 
sucl) as the New York Times we perceive this is an attempt 
tto r^each parents more than students. 
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to a ninimun of $^0. Their courses ranged in duration from 40 
hours (10 sessions at 4 hours each) of classroom indstruction 
plus unlimited use of library tapes and homework to a minimum 
of a one-day 8 hour seminar. Not surprisingly, the most ex- 
pensive courses had the longest duration, and the least 
expensive courses had the shortest duration. 

All preparation courses offer written materials as well as 
lectures. Their materials consist either of the commercially 
available review books 49 / or materials designed by the coaching 
schools themselves. By and large the majority of the materials 
consists of numerous examples of question types appearing, or 
expected to appear, on the various standardized examinations. 
One coaching school has an extensive tape library where over 
200 hours of additional preparatory instruction is available. 

The larger coaching schools have staffs of researchers 
who are constantly updating materials and writing practice 
examination questions. One school Is so vigilant in its quest 
to keep current its materials that it pays individuals to take 
a standardized admission examination for the sole purpose of 



49/ We have not endeavored to analyze the effects of »tre- 
— ly using one of these review books without attending a 
formal coaching course. Such use by subjects in our 
control groups would of course bias out ^findings against 
the coaching schools. - 
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remembering the examination questions, 50 / The value of this 
practice is questionable. A study was commissioned by the 
College Board because it was believed some operators of 
coaching programs obtain some items that have been included in 
past editions of the SAT. The coaching materials consisted of 
actual items that later appeared on the SAT the subjects would 
take. The author concluded that "...even if it were possible 
to coach with as many as one-tenth of the items that would be 
used on a future form of the SAT — a virtual impossibility 
— the effect on the scores of students coached with these 
items would be negligible. "51/ 

There is much variance among the techniques used by 
coaching schools. They cover a continuous spectrum. The 
simplest approach is teaching solely test-wiseness which is 
devoid of substantive content and mainly concerned with exam 
taking techniques- A more elaborate technique is short-term 
instruction (STI). This is a relative term which includes 
both elements of test-wiseness and substantive content. .The 



50/ Seer Transcript of Investigational Hearing of John 
Sextonr February 9, 1977, p. 41-42. 

•I wouldn't want ETS to know our operation, but let 
me say that we do have people who take the tests for 
us which obviously is a way of monitoring." 

51/ French, John W., An Answer to Test Coaching, College 
Board Review, No.^7, Fall T555, p. 5-7. 
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duration of instruction is short compared to the amount of 
tine the test administrators would have us believe it takes 
•to develop the abilities (over a lifetime) that standardized 
admission examinations measure. The most elaborate teaching 
technique employed by the coaching schools is intermediate- 
term Instruction (ITI). ITI is of the same nature as ST I 
although somewhat longer in duration. It is however of 
relatively short duration when compared to the amount of 
time generally considered necessary for substantial changes 
in test scores to occur. _52/ 

Although there is no bright line that serves to determine 
where one of these approaches ceases and another begins, both 
the nature of the materials used by test preparation services 
and the length of instruction leads us to conclude that the 
majority employ short-term instruction techniques. Organiza- 
tions offering formal instruction for a weekend or less engage 
in teaching solely test-wiseness. The Stanley H. Kaplan Educa- 
tional center, Ltd. (provided the 200 hours of library. tape 
are used) may be viewed as offering intermediate-term in- 
structlon. 

Mmost all teachers at the coaching schools have obtained 
or are in the process of obtaining graduate degrees. Another 

52/ See, n. 25, at 4-5, supra. 
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almost uniform requirement for teaching at a coaching school 
Is scoring extremely high (minimum of 650) on one or more 
standardized admission examinations. 

Although we have confined our initial inquiry to LSAT 
preparatory curses in the metropolitan areas of Boston, 
New York, Chicago, and Los angeles and our SAT inquiry to 
preparatory courses in the metropolitan New York area, we are 
aware of commercial coaching schools existing in every state 
and in virtually every major city or college campus throughout 
the country for all standardized admission examinations. 53/ 

Although the coaching school industry may not be large 
in terms of annual sales by some standards, the industry 
structure already exists which enables it to reach any of the 
approximately 2,500,000 individuals who annually will be 



53/ A list of some of the locations of coaching schools 
follows; 

Brooklyn; Buffalo; Manhattan; Syracuse; Albany; Ann 
Arbor; Atlanta; Augusta; Austin; Birmingham; Boston; 
Champaign; Chicago; Charleston; Cleveland; Columbus; 
Dallas; Denver; Detroit; Durham; East Brunswick; Gains- 
ville; Houston; Indianapolis; Jacksonville; Kansas 
City; Los Angeles; Louisville; New Orleans; Omaha; 
Palo Alto; Philadelphia; Pittsvurgh; Portland; San 
Francisco; Seattle; St. Louis; Tallahasee; Tampa; 
Washington D.C.; Toronto; Lugano, Switzerland; Euclid, 
Ohio; Clinton, Iowa; Knoxville; Boulder; Fort Worth; 
Baton Rouge; Baltimore; Montreal; Columbia and Greenville, 
South Carolina; Miami; Harrisburg; Oxford, Jackson, 
and Columbus, Mississippi; Orlando; Tuscaloosa, Opelika 
and Mobile, Alabama; Lexington, Murray, Maehead, and 
Bowling Green, Kentucky; Fayettevllle; Little Rock 
and Jonesboro, Arkansas; Phoenix; Tuscon; Milwaukee; 
Madison; Salt Lake City; and Utlca. 
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taking a standardized admission examination. It has the 
potential to grow quite rapidly 54/ •"'^ ^^"•^ 
sales of one-half billion dollars.55/ Furthermore there 
are almost no entry barriers to this industry.56/ 

The charts appearing on the following pages represent 
for each of the entities we have specifically examined, name 
of the coaching school, total annual sales (1975-1976), number 
of students enrolled (Oct. 1974 - Dec. 1976), advertising 
expenditures (1976), cities where courses are offered, dates 
when courses have been offered up to December 1, 1976, costs 
of the course, and length of the course. ^ 

B.-^o hac recently acquired a coaching school 
?,'^a;"mETHoS)! ?his acquisition by a $300 million 
(I.SAT METHOD). * ^^idence of the potential 

roJ'i^ptd'-niai'saJer expansion of this industry. 

I- r 0 000 Students who takes a 
^/ r-nSrrliPf ad £io^^ each year^enroUed 

["ndSstry^ru?d^fare\*nnu:; "sales^f 5500,000,000. 

Se/ Franchisees of the Evergreen ' ig^eeSe^ t 

pay only 520°"P°Sf^Jhe gross up to $90,000 and 15% 

and then 33 1/3% ot tne gro f m piie 

of the g>^«>"°ver $90,000. f^e, caceg y interest 

772 3000' ^f;,^^'e ;rrnu;eroSs high ^.^ool and college 
to note that there are nu students for standard- 

nefrxlml ofi part tLr basis, and we are unaware of 
ij? 8?"e imposed licensing restrictions. 
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NANCOr 
ORGMIUTIOII 



mi 

ANNUAL SALES 
1975-1976 



1976 

sTuuMi^ ADVERTISING "TIES 
10 ?S^12/76 BXPE«OimES HHBRE OFFERED 
(Dollars) 



NUHBER OF 
STUDENTS 



DATES 
OFFERED 



COST OP WNGTH OF 
COURSE COURSE 




Stanley H. Mplan 7,834,093 1/ 
Educttlonil 
Ctnteti ltd. 



4975 2/ 
1504 V 



209,357 



over 50 cities 
In U.S. plus 
Toronto and 
Lugano, Swltz. 



Prior to $250-tSAT 10 weki Jt 
10/74-12/76 $225-SAT 4 hri./«k. 




Adit/ Review 
Course 



267,000 1/ 



677 4/ 
1500 V 



26,001 



over 20 cities 10/75-12/76 «m or 
In U.S. '"^ 



30 hours 
or v^ekend 




John Sexton' I 
LSAT Review 
Course 



Law School 
Adnlsslon Test 
Rev lev Course 
(Evergreen) 



511,484 6/ 3020 6/7/* 40,000 8/ 



NY, BOS., DC, LA, prior to 
Houston, Tanpa, 10/74-12/76 
and others 



$95 

$150 
$250 



236,547 9/ 
43,667 To/ 
9,220 TI/ 



1738 12/ 

1216 n/ 

367 W 
187 TT/ 



30,000 



In excess of 
60 locations In 
U.S. and Canada 



Prior to 5125 
10/74-12/16 S250 
2/75-12/76 10/ 



16 hours 
28 hours 
40 hours 



30 hours 
40 hours 




1/ Nationally for all eMBS 

2/ BoSm NT, Chl„ LA (LSATl 

3/ N! only (SAT) 

U los., Clil., NY, 

- WonlylLSAT) 



5/ Nationally (LSAT) 8/ Estimated. 



11/ Chi. franchisee 



; includes.^ "^ZA^ 

^" ''^ • does not Include HCAT revenue ;J|JJ'J,;"y„r 

7/ Ho records 6f students 



13/ Due to' poor record retention 
this represents nuiber of 
nanes In our possession. 
ApproKlMtely 75 are ilsslng 
for 12/76, 75 for 2/76, and 
538 for 4/75 and 7/75 
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TOTAL' NUMBER OP 197S 
NANeOr ANNUAL SALES STUDENTS ' ADVERTISING 

oKatioh mm im-m nmmm 



CITIES 
HHBRB OPPERBD 



DATES 
OFFERED 



COST OP LENGTH OP 
COURSE ' COURSE 



AKS EducitionAl })iOOO U/ W 15/ 



unknown NX/Boston 



20 houti 



urn (ARC) 60,166 2/ . <17 K/ est. 



ISAT 
METIIOO 



15,000 
ippx. 



Wcitern States 42,526 
Btvitu 



Teit Kip ' <3,4n 
Chlca)0 



283 17/ 
485 T!/ 



3), 000 NY/NJ 



10,000 



10/75-12/76 



LA.iSPhSO., 
Salt Uke City 



$85 
$115 
$195. 



lD/75-12/76 $40 



115 17/ 
500 W 



14/ LSATonly 

15/ ISAT only (ilio offtred 
couriei for other axans) 



IS/ All coursai total 18/ All cltUi total 
1?/. LA only 



20 houfi 
(weekend) 
7 lessioni 
• 21 bourii 
44 houti 

(11 UlllOAl) 



Hay 
(8 hottri) 




5,000 LA, SF, Seattla 10/75-12/76 $85 • 16 Jwrf 
est. Honolulu ' 

unknown Chlca90 



2/75-12/76 unknown unknown 
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mi OP 

ORGAlilZATlOH 



mi NUHBBHP 1576 
WNUAL SALES mmt^ ADVERTISING CITIES 
75-1976 10/74-12/16 EXPENDITURES HHERE OFFERED 

(D0lla"A. .i- 



DATES 
OFFERED 



COST OF 
COURSE 



Test Prep 
QoBton 



32,400 



•Coluibla test 62,600 

Preparation 

Institute 



Lav Board 22/ 
Rev lev Center 



34,907 



Creative Educa- 3,960 
tlonal Services 



Law Boards 
Institute. 



9,500 



Tutor Inf . 
Service 



S.400 



Guidance 
Center 



S,745 



ii 19/ 
205^0/ 



514 21/ 



102 22/ 



SO 



9 25/ 



19/ LSATonly 
20/ Total all esaM 



2660 



Boston, 
Amherst, HA 



9/75-lX/^ii 'a49 




9000 NY 



5/75-12/76 5135 



3000 est. thruout United 
States 



Prior to 
10/74-12/74 
10/75- 7/76 



$85 



38 23/ 1200 ,LAwSP 



10/76-12/76 



$60 
$160 



70 24/ negligible NK 



unknown NV 



10/74-12/76 $100 
$175 



8375 ■ t-A 



21/ All exams, 

" Doesn't coach LSAT 

22/ Including franchises 
in NT area only 



23/ LA only 
24/ Estimated 
25/ LSAT only 



LENGTH or 
COURSE 



6 neetlngs 
(24 hours) 



( leetlngi 
(24 hours) 



10 hours 
(one weekend) 



13 hours 
24 hours 




7/75- 1/76 $154 30 hours 

16 hours 



20 hours 
(5 sessions) 




7/76-10/76 $125 20 bouts 
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HMteOP 
ORGANIZATION 



Dultc 



mL NOHB^R OP 1976 
AHNOAl SALES STUDENTS ADVERTISING CITIES 
1975-1976 10/74-12/76 BXPEMDITtlRES NHERE OFFERED 

(Dollars) 



DATES 
OFFERED 



COST OP 
COURSE 



46,952 26/ 10 27/ negllqlbU Nlf 



Prior to $110- 
10/7M2/76 $135 



LENGTH OP 
COURSE 




10 houri 
(private) 



A. Nandell 

Education 

Center 



NcBurney 
YNCA 



negligible 16 28/ negligible U 



unknown 



College Entrance 14|200 
Testing Service 



College Skills unknown 
Center 



Test Prepari- 88,777 
tlon Center, 
Inc. Ny 



18 

160 29/ 



H2 30/ 



595 30/ 



negligible NV 



unknown 



4723 



Incomplete negligible NK 
records 



Ny 



unknown 



unknown 



uDknoMi unknown 



prior to 

</75-ll/75 $100 
</76-ll/76' 



$75 



7/75-10/75 unknown unknown 



30 hours 



prior to $19$ 30 houri 
10/74 $65 6 hours 



2< hours 



26/ Includes all courses 

27/ ISA! 

28/ All courses 

29/ Total 1973 - 1975. 142 occurred before relevant tlie frame. 

30/ SAT only (8o«e names may be missing). 
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B. MQT-POR'PROFIT 

We have been aware from the outset that the not-for- 
profit segment of this industry was one which required our 
attention.57/ There are a large number of undergraduate 
colleges and universities that offer preparation for admission 
tests to graduate schools.58/ It is ironic that colleges and 
universities offer preparatory courses. If they truly believe 
that coaching is effective for graduate standardized admission 
examinations then it seems logical they would concede coaching 
is effective for the SAT. Yet these very schools employ the 

57/ see Circulation by Commissioner Dixon, Category I File 
^ 762 3033, vol. I, p. 85, wherein he stated: 

I have no objection to this investigation, but I would 

2f e*-^ff as it seeks to formulate standards for the 
lldvertisinq of thil respondent to ask itsemf how the 
not- o -proftt segment of this industry would stack up 
aaainst those standards. While two wrongs (if that is 
Shat is involved here) do not make a right, we should 
Se caieful in areas such as this, where the underlying 
tLSes may involve some measure of controversey and 
novelty ?hat the effect of our actions is not merely 
TcJeaie a double standard, <3i^f/-°^ i:;^,,;^^^,^"^^^^^""^"^ 
without eliminating the source of the ailment. 

sfi/ see generally. Category II File 772 3000, Vol. I, 

n 27-5o! Amo^g those offering such courses are Columbia 
SATvprsitv (LSAT), Bentley College (LSAT), Fordham 
Snive si'tj lIaT) California State University (LSAT), 
UniJeJsity of Michigan (LSAT), Boston College (LSAT), 
^e^c^n'Sniversity (LSAT), Cornell Un i vers ity^^^^ 
PiiaPt Sound (LSAT), Monrovian (LSAT), Colby (LSATJ, 
rSiinhi^L^T) University of Mass. (LSAT), Amherst 
S) Bos^oi'uSiiersity^LSAT), Scranton (LSAT), 
it Hoivoke (LSAT), Chatham (LSAT), Washington Um- 
ve^sUy (lIat), Trinity (D.C.) (LSAT), and University 
of Houston (GRE). 



SAT as a prerequisite for admission and as a predictor of 
academic success. Furthermore if these colleges believe the 
SAT is coachable then they are employing an unreliable, in- 
valid predictor, and they believe it is not coachable then 
by analogy the graduate admission examinations are not coach- 
able and they are wasting students' time and money. 

Tne not-for-profit segment of this industry can attempt 
to rationalize its offering of preparation courses for gradu- 
ate schools in a number of ways. First, the not-for-profit 
courses are usually offered at no charge or at a minimal charge 
to cover overhead.59/ Second, some members of the not-for- 
profit segment of the industry offer coaching as a means of 
diverting students from the commerical courses. They believe 
that coaching (imiluding their own) serves as no benefit but it 
is better to serve no benefit gratis than it is for up to 
$250.60/ Third, the not-for-profit coachers may believe 

59/ see Category III File 772 3000, Vol. I, p. 43. Statement 
— of Fordham University, (no charge). 

60/ see File 772 3000, Physical Exhibit Q p. 4, and 
Category III File 762 3033, p. 33-36. See also. 
Pre Law Gu idebook of Boston College , Chestnut Hill, MA 
TTf7TfpT^h-^en:tnT-?tate;r7Hir can prepare for 
the LSAT . to the extent of becoming familiar with 
t£e types iiquestions asked. It has been my experience 
that a thorough perparation with the questions that 
ire offered in the Pre-Law Handbook, the Admissions^ 
Bulletin and the $5 Arco or Barrens preparation book 
win eUmiSate the need for expensive professional 

^ e-law courses." Yet, ' rs' '?The 

preparation course for a fee of five dollars. (The 
fee is to cover costs of overhead and printing). 



that they are effective. Realizing the importance of stand- 
ardized admission examinations in the graduate school process 
they may feel that by increasing the scores of their under- 
graduate students they increase these students' opportunities 
for graduate school admission and therefore enhance their 
own undergraduate school's reputation. 

Not only does the not-for-profit segment of the industry 
charge minimal or no tuition but they also engage in 
virtually no advertising. Furthermore their enrollments are 
rather small.61/ The not-for-profit segment of the industry, 
although existing at many schools, has a small total en- 
rollment 62/, charges de minimus fees, and does not advertise. 

There is one notable exception to the general description 
of the not-for-profit segment of this industry that we have 
discovered. Recently, for a fee of $125.00, St. John's Uni- 
versity in New York began advertising for an SAT Prep Course.6_ 
Not only was this fee comparable to that charged by some of 
the commercial entities but the literature distributed was 

61/ Columbia U. enrolled 4 0 students from 1974-1977. 
^ See Category III File 772 3000, Vol. I, p. 28. 

62/ Probably not more than 5000 students nationally. 

63/ See Category III File 772 3000, Vol. I, p.70. 
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-commercial- in nature.64/ This is the only instance in which 
we found a university offering a coaching course for the very 
examination it uses in determining, at least in part, who 
will gain admission. 65/ 

we have not discussed the not-for-profit coaching that 
occurs in public and private high schools across the United 
States for the SAT. These are largely unadver tised , voluntary, 
non-fee courses and as such would not cause any economic harm 
to the student taking one, although they would be a waste of 
time if valueless, but would result in social and economic 
harm to those who are denied access to them if they are bene- 
ficial. Due to the nature of the statistical analysis of the 
SAT the inclusion of these entities in our inquiry is not 
necessary but we will as a by-product: make recommendations 
concerning means of offering a gauge of their effectiveness. 



64/ Id. 

(.^/ For the full text of an interview with a Jean of 

S? Johr's university regarding its SAT preparation 
coirse and his rationalization for its existence, 
lee "Itegory HI File 772 Stvoc, Vol. I, p.7i. 
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VII . STATISTICAL AND COMPUTER METHODOLOGY 
The reader who has little interest in the complexities of 
statistical and computer methodology may bypass this section 
without a loss in continuity. The following section, "Statis- 
tical Findings" details the analytical results of this inquiry. 
A. Purpose of Study 

The statistical study determines whether commercial coach- 
ing courses can significantly increase students" SAT and LSAT 
scores. If commercial coaching were found to be effective, a 
secondary study purpose was to determine whether various commer 
cial courses vary in effectiveness. Particular study questions 
were as follows: 

(1) Are SAT and LSAT scores of coached students signifi- 
cantly higher than the scores of comparable students 
who are not coached? 

(2) If coaching is effective, what is the estimated size 
of score increase attributable to coaching? 

(3) If coaching is effective, does its impact vary among 
different types of students? 

To the extent that coaching can improve students" scores 
on the SAT and LSAT, questions may arise concerning test de- 
sign, interpretation of test results, and perhaps the precise 
nature of what such tests are measuring. Although intriguing, 
such questions are beyond the scope of this statistical study* 
The sole purpose of this study was to estimate statistically 
the impact of commer ical coaching upon SAT and LSAT scores. 

45 
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B. Mternative Approaches 

TWO major alternative approaches exist for estimating 
the effects of coaching upon SAT and LSAT scores. The first 
approach is to conduct an experiment. The second approach 
is to treat an existing situation as if it was an experi- 

mental result. 

Conducting a coaching experiment requires aefinlng two 
comparable groups of students. Members of the experimental 
group enroll In coaching courses, while members of the control 
group receive no coaching. The purest methods to acquire 
these two groups would be to deny access to commercial coach- 
ing on a random basis to one-half of the potential coaching 
school enrollees, or treat the control groups with a placebo. 
If the experimental and control groups are In all other ways 
similar, then SAT and LSAT score differences between the groups 
would be attributable to coaching. 

Analysis of existing circumstances requires identifying 
students who voluntarily enroll in coaching courses. Also 
identified are students who choose not to enroll In coaching 
course.. These two groups correspond, respectively, to the 
experimental and control groups of the first approach. As 
with the experimental approach. If the enrollee and nonenroUee 
groups areln all other ways similar, then SAT and LSAT score 
differences between the groups are attributable to coaching. 



46 



61 



Both approaches have their benefits and detriments. The 
exj>erimental approach is preferable because it avoids self- 
selection of enrollees into coaching schools and because it 
assures that the presumably uncoached students are in fact 
uncoached. Self-selection can be important if students 
attempt the SAT or LSAT under severely competitive conditions, 
under such conditions, aggressive individuals intent upon im- 
proving their test scores might be more likely to enroll in a 
commercial coaching course than their less competitive or less 
affluent counterparts. Also, students whose first SAT or LSAT 
attempt produces unexpectedly low scores may be more likely to 
elect commercial coaching than students whose first exam score 
more closely matches their expectations. If aggressive atti- 
tudes lead to better exam scores even without coaching or if 
coaching school enrollees are mostly students receiving unex- 
pectedly low first scores, then score gains or differences 
attributable to coaching may contain a self-selection component. 
That is, self-selection may lead to an overestimate of coach- 
ing benefits. 

conversely, a nonexperimental control group may lead to 
an underestimate of coaching benefits. That is, presumably 
uncoached students may in fact receive some form of coaching 
other than formal enrollment in a commercial coaching course. 
They may for example attend courses given by the not-for-profit 
segment of the industry, engage in extensive self-preparation. 
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or attend a commercial entity surreptitiously due to a desire 
to receive coaching. These unmonitored efforts, if they occur 
and if they are effective, should tend to increase the average 
test scores of the allegedly uncoached students. These in- 
creased scores, containing a component properly attributable 
to coaching, tend to shrink the apparent benefit from commercial 
coaching. 

On purely theoretical grounds the experimental approach 
may be preferable. However, the experimental approach is ex- 
pensive, lengthy, and in the real world almost an impossibility 
as it would require denying access to commercial coaching to 
subjects who want it, or to treat them with a placebo. Also 
it would have conflicted with our investigative goals in 
that a sufficiently large sample for statistical purposes is 
unlikely to remain a secret from the coaching schools. Coach- 
ing provided in awareness of an experiment may differ from the 
coaching normally provided. Since the purpose of this investi- 
gation was to evaluate commercial claims made for "normal" - 
coaching provided in the absence of awareness of an experi- 
ment, and because of limited time and study resources, we 
used nonexper imental data. 
C. Overall Study Design 

Given the practical considerations of time, cost, and 
security, this study used a nonexper imental approach to 
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estimating the effects of coaching on SAT and LSAT scores. 
The major study elements were as follows: 

(1) definition of a study group of SAT or LSAT-takers; 

(2) separation of coaching school enrollees from nonen- 
rollees; 

(3) establishment of subgroups with similar backgrounds; an 

(4) comparison of cbached and uncoached students within 
subgroups. 

The major study assumptions were and are as follows: 

(a) the study group is representative of SAT and 
LSAT populations; 

(b) SAT and LSAT exams are comparable among adminis- 
trations; 

(c) coaching school performance is consistent during 
the study period; and 

(d) the effects of enrollee self-selection, if any, 
and of coaching of presumably uncoached students 
offset one another. 

A brief discussion of the study elements follows: 

(1) Definition of study group . The study group defini- 
tion began with coaching school enrollment lists obtained from 
the coaching schools. These enrollments contained student- 
names, addresses, and course dates covering the testing years 
1974-1975, 1975-1976, and 1976-1977. This 3-year study window 
was defined by several factors including: 

(a) incomplete, illegible, or missing coaching school 
enrollment records prior to 1974; and 

(b) a desire to avoid any confounding influence 
from long-term gradual declines in average SAT 



scores. 
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AS previously indicated SAT coverage was confined to two 
coaching schools in the New York metropolitan area; LSAT 
coverage included coaching schools in the Boston, New York, 
Chicago, and Los Angeles metropolitan areas. Inspection of 
the student addresses allowed definition of the primary mar- 
ket areas served by the surveyed coaching schools in these 
metropolitan areas. These market areas are compact, contigu- 
ous areas which generate most of the coaching schools' en- 
rollment. At the 3-digit level of Zip Code geography, the 
SAT market area for metropolitan New York was: 
064-069 Connecticut 

070-080 New Jersey 
! 085-089 

. 100-127 New York 
The LSAT primary market areas were: 

010-029 Massachusetts ) Boston 



070-080 New Jersey 
085-089 

100-127 New York 

463-466 Indiana 

530-538 Wisconsin 

600-619 Illinois 

900-937 California 



New York City 



Chicago 



) Los Angeles 
Given these geographic market areas, CEEB, LSAC, and 
ETS then provided the test records for all persons located in 
these areas who attempted the SAT or LSAT during the study 



window. This large group of persons, containing both coached 
and uncoached students, constituted the preliminary version 

of the study group. 

(2) Separation of enrollees from nonenrollees . Separat- 
ing enrollees from nonenrollees began with identifying coach- 
ing school enrollees within the" large group tested during the 
study period. Essentially, this task consisted of taking a 
coaching school enrollee's name and address and searching the 
testing data until that person's testing history was found. 
The goal of this task was to establish for each person a com- 
pact data set containing the person's testing history, coaching 
history if any, and relevant biographical information. 

For a variety of reasons, this proved to be a fairly 
formidable undertaking. LSAT statistical analysis began with 
11,906 coaching school enrollments and 157,982 testing histor- 
ies during the 3-year study window. Computer matching using 
zip code, surname, and first initial located 9,479 testing 
histories for coaching school enrollees. Subsequent manual 
matching, for enrollees whose testing histories were not found 
by computer search, located an additional 2,869 testing 
histories; the manual search was required because of the use 
of nicknames, misspellings c;nd the like. 

For the 11,906 coach^n^ school enrollments, we had now 
located 12,348 testing histories. Clearly, some persons 
had participated in more than one LSAT testing year. The 
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resulting search for the same persons in successive testing 
years shrank the total LSAT study group from a presumed 
157,982 to an actual 132,003. Of these, some 7,981 had taken 
all their LSAT tests prior to test year 1974-1975; these per- 
sons were dropped from the study. 

This left a group of 124,022, of whom 8,660 had a total 
of 9,029 coaching school enrollments, implying that the study 
contained at least a few people who had been coached more than 
once. In addition, scanning sample testing histories indicated 
that many people had attempted the LSAT more than twice. To 
make sense of this situation, the following table was produced: 
Number of times coached for LSAT 



number of 
LSAT 

attempts 



totals 





0 


1 


2 


3 


4 


5 


totals 


1 


81,57^ 


3,722 


69 


0 


2 


0 


85,368 


2 


26,660 


3,172 


113 


4 


4 


2 


29,955 


3 


6,093 


1,146 


69 


7 


2 


3 


7,320 


4 


785 


223 


26 


3 


2 


0 


1,039 


5 


190 


56 


9 


0 


0 


0 


.255 


6 


42 


13 


3 


0 


0 


0 


58 


7 


13 


5 


0 


0 


0 


0 


18 


8 


3 


3 


0 


1 


0 


0 


7 


.9 


1 


1 


0 


0 


0 


0 


2 




115,362 


8,341 


289 


15 


10 


5 


124,022 



Inspection of testing histories suggests tha^, these groups 
tend to perform rather differently on the LSAT. This finding 
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in turn suggests that comparability of enrolleos and uncoached 
students required some assurance that apparent 1-time takers 
are in fact 1-time takers and contained no persons for whom 
the presumed single LSAT is really the first of two attempts 
or the begining of an extended LSAT taking career. 

Because proper analysis of all combinations would have 
entailed research design complexity sufficient to overwhelm 
available sample sizes, and because 115,129 or 93% of the LSAT 
study group had the "normal" LSAT experience of fewer than 3 
LSAT attempts ar3 fewer than 2 coaching school enrollments, 
persons coached more than once or with more than 2 LSAT exams 
were excluded from the study. 

The apparent 1-time cakers, 2- time takers, and 3- time 
takers were used to conduct a "window analysis". The purpose 
of this task was to discover how far to narrow the study win- 
dow so that students thought to be 1-time takers were indeed 
likely to be 1-time takers, and students thought to be 2-time 
takers were also likely to be 2-tirae takers. The actual 
analysis consisted of constructinn time profiles of 2-time 
takers and 3-time takers. The ti profiles indicated how 
Bany intervening LSAT exams passed between successive attempts. 
Because the. latest LSAT coaching school enrollments were for 
December 1976, and because this group contained a considerable 
number of coached persons, we were extremely interested in 
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the effect of using that LSAT as the new boundary fot the 
study window. The results were as follows: . 

. of LSAT repeaters with 3 or fewer intervening 
ni"ellll "blt-een ".?«ssive attempts 

2-time takers 3-time takers 



1 to 2 



1 to 2 2 to 3 



75,8 ' 86.8 55.6 



89.0 



96.1 63.0 



82.4 86.1 65.6 

88.0 56.0 



uncoached students 
coached before 1st 
'coached before 2nd 
coached before 3rd 

;.ssun,ln, that these ti.e profiles o£ LSAT repeaters are 
stable through time, and beca.se three ^AT administrations 
followed the December 1976 LS.T during the 1976-1977 test year 
,the test year commences in October and terminates in July,, we 
can estimate that about 76» o£ uncoached 2-time ta.ers whose 
Urst attempt occurred in December 1976 would, if they are 
destined to remain uncoached 2-time ta.ers. appear for thexr 
second uncoached tS.T attempt before the end of the test year. 
. similar interpretation applies to the other percentages. 

It would have been more comforting to work consistently 
„ a level of 95%, but this would have required such a narrow- 

..v 4- 107^-1977 test year data 

Ing of the study window that all 197. 197/ 

rHori Because the study group was about 
would have been discarded. Because i. e / 

e„ Shrink drastically, reasons described infra, it was 

aecided to leave the LSAT study window at Octobe. 1974 through 
December 1976 inclusive, m any event, the LSAT study group 
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was then partitioned into five subgroups based on coaching 

experience: 

(1) uncoached 1-tlme takers; 

(ii) coached 1-time takers; 

(iii) uncoached 2-time takers; 

(iv) 2-time takers coached before first exam; and 

(v) 2-time takers coached between exams = 

A similar adventure marked definition of the SAT coached 
and uncoached groups. An additional complication arose be- 
cause the SAT testing histories arrived in fragments; that 
is, one person's data was likely to be found in several iso- 
lated pieces, even within a single testing year. As a result, 
the entire SAT data file was sorted alphabetically and a list 
of -candidate matches" was generated for each surname in the 
coached group. Because of use of nicknames, apparent misspell- 
ings, and variations in format of street address, manual search 
of these candidate matches was used to find the SAT testing 
histories of coaching school enrollees. Testing histories 
were located for 1777 of the 2286 SAT coaching school enroll- 
ees. Part of the failure to locate testing histories for all 
enrollees in both the SAT and LSAT files is of course attri- 
butable to the failure of a coached individual to utlimately 
take a standardized admission examination. Because the SAT 
data consisted of so many elements and was so scrambled, a 
sample of uncoached persons was felt to be the most reasonable 
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ana efficient «.y of est.bllshin, . control group. The target 
s.«ple size of 2500 «as chosen to yield a control group com- 
parable in number to the coached group. Systematic selection 

J « e«-«rfr was used for two reasons: 
with random start was uacu 

. -"r?"^e^ttnrKt^t^^lL"^eSo;^dn^^^unJ^°oS.?^lty 

individuals' testing g^piing , which would ordi- 

•„t?!;rbrusea1riuorft:tfs?!«r;valuatlon of results, 

and 

«i"'^rdirrur«nt!rnrd"^?iTtufertsTn"ri:5' 

jrihe1nvertt5:ter?o!c"ng"scSools during the study 
per iod • 

Choosing an integer between 1 and 150 from a table of 
rando« digits and then selecting that data record plus every 
succeeding 150th data record yielded a sample of 2597. The 
same type of "window analysis- as used for the ts*T showed that 
a December 1976 cutoff allowed wording at the 95» level, .s 
with the LSAT part of this study, the SAT study group was 
divided Into five subgroups: 

(I) uncoached 1-tlme takers) 

(H) coached 1-time takers; 

(Hi) uncoached 2-tlme takers! 

,lv, 2-tlme takers coached before first exam, and 
(v) 2-ti>ne takers coached between exams. 

,„ HiSfeliainent of sub^roOES 
The reason for establishing subgroups with similar backgrounds 
«.s to avoid bias either for or against coaching schools. The 
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reasoning was that intergroup ethnic, academic, or sex dif- 
ferences might lead to corresponding SAT or LSAT differences 
and, possibly, to differences in coachability . Therefore, by 
an extensive sorting of LSAT test scores we attempted to dis- 
cover whether significant LSAT score differences existed, 
coaching aside, among groups defined by sex, ethnicity, cumu- 
lative grade point average (GPA), and combinations of these 
attributes. This sorting revealed that LSAT scores: 
(i) vary moderately with GPA; 

(li) are markedley different for different ethnic 
(and racial) groups; and 

(iii) display only slight differences for males versus 
females . 

Therefore, as described infra , analysis of the effects of 
coaching was confined largely to whites. 

Restricting attention to persons for whom biographical 
Information was available further reduced the LSAT study group 
size. For instance, using a group whose LSAT exams fit within 
the study window of October 1974 through December 1976, whose 
GPA was known, and for whom no score irregularities were 
recorded produced the following study group. 

coached uncoached 

1- time takers 2,272 30,459 

2- time takers 2,090 10,832 

Requiring information on sex and ethnicity shrank the 
study group still further. Excluded here were persons whose 
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sex or ethnicity were unknown or whose records contained 
contradictory intoimation, such as being black one year and 
oriental the next year. The resulting SAT study group th^n 
appeared as follows: 

coached uncoach ec^ 

1- time takers 1.571 22,136 

2- time takers i.259 6,651 

Indians and orientals appear to perform differently on 
the LSAT when compared to other non-whites. Therefore, and be- 
cause these groups comprise only a small part of the uncoached 
group and a miniscule portion of the coached group, they were 
excluded from further analysis. The resulting final definition 
of LSAT study groups is shown below; as used here, non-whites 
include blacks, chicanes, and puerto ricans. 

wh i te • nonwhite 
uncoached 1-time takers T?7547 77TT5 

coached 1-time takers 1,395 147 

uncoached 2-time takers 5,729 781 

2-time takers coached before first exam 672 54 
2-time takers coached between exams 1,113 128 

Fortuitously, the SAT study subgroups proved to have 
very similar socioeconomic profiles, so that no further prun- 
ing or subdividing was necessary to assure comparability. The 
only qualification for inclusion in the final group, for rea- 
sons described infra, was a Pre-Scholastic Aptitude Test 
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(PSAT) baseline score prior to the first-SAT administration. 

The resulting final SAT study subgroups were as follows: 

uncoached 1-time takers 384 

coached l-time takers 109 

uncoached 2-time takers 494 

2-time takers coached before first exam 248 

2-time takers coached between exams 246 

(4) Comparison of coached and uncoached students . The 
basic approach to detecting coaching effects was quite straight- 
forward. For both the SAT and LSAT portions of the study, a 
baseline was established to compare coached students against 
uncoached students. From this baseline were generated expected 
average test scores for coached students and for uncoached 
students. Direct comparisons of these average scores were 
then used to evaluate the effectiveness of commercial coaching. 

PSAT scores furnished the SAT baseline, while undergraduate 
GPA provided the LSAT baseline. Both baselines were chosen be- 
cause of availability, convenience, and apparen. reasonable- 
ness. Although GPA is clearly inferior to PSAT on the basis 
of reasonableness, because of the universal uniformity of 
PSAT scores, it appeared to be the only v'.vailable base- 
line for the LSAT when analyzing one-time takers. 

For both the SAT and LSAT analyses, the technical approach 
was the same. Ordinary least-squares linear regression was 
used to generate conditional average exam scores for both 
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coached and uncoached students. Estimated impacts of coach- 
ing were then inferred from comparisons of these conditional 
averages. 

The statistically sophisticated reader will immediately 
note the absence of fiducial lines around the linear regression 
estimates. This omission is deliberate. Strictly, fiducial 
lines can be drawn only where the underlying data is the pro- 
duct of sampling where sample selection probabilities can be 
calculated; because the calculations are convenient and well- 
known for simple random sampling, this approach is normally 
used. However, investigatory requirements and constraints 
of time and cost have prevented this statistically desirable 
approach. Fortunately, the difference between coached and 
uncoached student scores is sufficiently large that the 
absence of this formal statistical test appears t6 be a minor 
defect. 

At this point it is of value to focus on the terms 
-control" or "uncoached". They have been used in the preced- 
ing discussion as well as in other parts of this memorandum 
and are used on labels on the charts and graphs appearing 
infra. These terms are somewhat misleading. We have not 
determined to a certainty that the -uncoached" or "control- 
groups have in fact been culled of all coached subjects, 
some subjects may have attended a coaching school we have not 
identified, they may have undergone extensive self-preparation. 
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they may have been coached by the not-for-profit segment of 
the industry. For purposes of convenience we continue to 
use the terms "uncoached" or "control" remembering that due 
to the probability these groups are not pure we will have 
underestimated the benefits of coaching. 

VIII. STATISTICAL FINDINGS 
The following discussion analyzes with statistical 
methods the effects of coaching on the Scholastic Aptitude 
Test and Law School Admission Test. 

It is important to keep in mind that although this docu- 
ment is meant to be self-contained, it does not include all 
of the different approaches and methods we have employed in 
attacking the problems we faced. For example missing from 
this discussion are histograms, frequency tables, and analysis 
by stratification (although this is in essence included in the 
regressions) . 

In order to fully understand the breadth of this undertak 
ing it is essential to make an in-depth review of the techni- 
cal appendices. However such a review is unnecessay to compre 
hend our findings. 

The charts and graphs appearing in this section that 
analyze individual coaching schools are labelled with either 
a numerical or numerical/alphabetical code in lieu of a 
coaching school's name. These codes are present due to the 
convenience they afford in labelling. The codes corresponding 
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to the coaching schools names are found parenthetically in 
the text of this section after the mention of a coaching 
school. The full set of codes which must be utilized to 
decode coaching school names in the technical appendices 
are attached hereto as Appendix A. 
A. THE SCHOLASTIC APTITUDE TEST 
(1) SAT 1-time. takers 

Actual SAT scores for 1-time takers appear on pages 
65-67. The first of these pages displays verbal and math 
scores for uncoached students. The second page shows verbal 
and math scores for students coached at the Stanley H. Kaplan 
Educational Centets, Ltd. in New York (SHK) (OOIA). The 
third page shows verbal and math SAT scores for students 
coached at Test Prep Centers in New York (022). 

Pages 68 and 69 compare average SAT scores for coached 
students against uncoached students. These comparisons indi- 
cate that SHK (OOIA) is extremely effective in coaching 1-time 
SAT takers. Average verbal SAT increases attributable to 
SHK's (OOIA) coaching range from 40 to 76 points above the 
uncoached group. Students who score higher on the PSAT re- 
ceive the greater benefits. Average score increases for the 
math SAT are 40 points above the gains of the uncoached group 
over the entire PSAT range. Students of SHK therefore who 
are coached in the period intervening the PSAT and the SAT, 



62 

77 



and who take the SAT only once, show a combined net increase 
of between 80 to 116 points above a matched control group. 

Although generally beneficial. Test Prep Centers (022) 
appears to be somewhat less effective than SHK (OOlA) for 
1-time takers of the SAT. Average verbal score margins for 
students coached at Test Prep Centers (022) range from an 
increase of 60 points for low-PSAT students to a decrease of 
33 points for high-PSAT students compared to the uncoached 
group. Conversely, average math SAT score differences range 
from an increase of 8 points for low-PSAT students to an 
increase of 40 points for high-PSAT students above the gains 
of the uncoached students. The total net benefit for 1-time 
SAT takers at Test Prep Centers (022) can be calculated to 
be between a range of -25 to +100 points compared to the un- 
coached group. 

To amplify on the preceding analysis SHK (OOlA) shows a 
gross verbal SAT increase from PSAT verbal of between +84 to 
+42 points from the low-PSAT to high-PSAT verbal scores. The 
corresponding control group shows an increase of +44 SAT 
points at the lowest PSAT verbal score to a decrease of -34 
points at the highest PSAT verbal score. Therefore the net 
benefits to SHK (OOlA) students range from +40 SAT points 
at the low end of the PSAT range C+84-+44) to +76 SAT points 
at thf high end of the PSAT range (+42 34). 
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Correspondingly SHK (OOIA) shows a gross math SAT in- 
crease of +68 to +39 SAT points from the low to the high end 
of the PSAT math range. The matched control groups shows an 
increase of +22 to a decrease of -3 SAT math points from the 
low to the high PSAT range. The net benefit therefore to SHK 
(OOIA) 1-time takers for the math SAT is roughly 40 SAT 
points over the entire PSAT range (+68 - +22 = +46 to +39 
- -3 = +42). 

This type of analysis can be done for each of the scat- 
tergrams presented here by merely inserting the appropriate 
figures into the formulas representing the regression lines. 

It is important to note that the figures recited in the 
preceding analysis are conditional average figures based on 
the equation of the regression line. The actual score in- 
creases or decreases may be considerably larger or smaller 
as can be seen from the plots of the scattergrams . 
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(2) ShT uncoached 2- time takers 

Actual SAT scores for uncoached 2-time takers of the SAT 
appear on pages 71 and 72. The first page displays first- 
SAT and second-SAT verbal scores. The second page displays 
first-SAT and second-SAT math scores. 

Page 73 compares average SAT scores for the students' 
first and second attempts. For both verbal and math scores, 
SAT improvement for uncoached students appears to be pro- 
portional to PSAT scores; a similar improvement pattern 
is shown later for uncoached white 2-time takers of the 
LSAT . 

The precise meaning of this improvement pattern is not 
clear. Possibly, two factors are at work: 

(a) Persons with higher initial test scores tend to con- 
tinue to develop further than those with initially 
lower test scores; and 

(b) Persons with higher test scores find the SAT somewhat 
"learnable" even without coaching. The fact that a 
similar score growth pattern occurs for uncoached 
white 2'-time takers of the LSAT, who are presumably 
already mature and unlikely to exhibit the rate of 
aptitude growth of younger SAT students, tends to 
support this hypothesis. 
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(3) SAT verbal scores for 2-tlme takers coached before 

first exam 

Actual SAT verbal scores for 2-time takers coached be- 
fore their first exam appear on pages 75 and 76. The 
first page displays first-SAT and second-SAT verbal scores 
for students coached by SHK (OOlA). The second page shows 
first-SAT and second-SAT verbal scores for students coached 
at Test Prep Centers (022). 

Pages 77 and 78 compare average verbal SAT scores 
for coached and uncoached students. The comparisons suggest 
that SHK (OOlA) is ciiarly effective for all students and that 
Test Prep Centers (022) is effective for low-PSAT students, 
but possibly counterproductive for high-PbAT students; how- 
ever. Test prep Centers' (022) high-PSAT stue^nts do recover 
much of their lost ground on their second S.vr attempt. 

SHK (OOlA) stude-^ts show average verbal conditional SAT 
score increases above a matched control group ranging from 
56.7 to 32.7 ; ■•;,nts from lo\v to the high PSAT scores. Test 
Prep Centers' 022) students reflect gains of 34.4 SAT verbal 
points at the low end of the PSAT range but ^osses of 55.6 3Ar 
verbal points at the high end of the PS/^T verbal range The 
second SAT verbal score for Test Prep Centers (022) reflects 
losnes of 22. C SAT verba^ point-, at the high end of the PSAT 
scale compared to the matched control orcup. 
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(4 ) SAT math scores for 2-time takers coached before first 
^ — exam 

Actual SAT math scores for 2-tirae takers coached before 
their first exam appear on pages 80 and 81. The first 
page displays first-SAT and second-SAT math scores for stu- 
dents coached by SHK (OOlA). The second page displays first- 
SAT and second-SAT math scores for students coached at Test 
Pren Centers (022) . 

Pages 82 and 83 compare average math SAT scores for 
coached students against uncoached students. Thesp compari- 
sons suggest that SHK (OOlA) coaches eff- -ively for 2-time 
takers, vith the greatest benefit going to low-PSAT students. 
SAT average score advantages range from 57 points for low-PSAT 
students to 16 points for high-PSAT students. Comparing second- 
SAT scores reveals an average difference of 74 points for low- 
PSAT students and practically no difference for high-PSAT students, 

Test Prep Centers (022) also appears to offer initial 
coaching benefits favoring low-PSAT students. This school's 
higher-PSAT students make considerably greater improvements 
than uncoached students on their second SAT. Test Prep 
Centers' students show improvements of 42 SAT math points 
at the low end of the PSAT range and decreases of 54 SAT 
math points at the high end of the PSAT scores. However 
their second SAT math scores increase 77.6 points from their 
first SAT math score at a high end of the PSAT range compared 
to an increase of 36.6 SAT math points for the control group. 
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-(5) SAT verbal scores for 2- time takers coached between 

exaros. 

Actual SAT verbal scores for 2-tiine takers coached be- 
tween exams appear on pacfes 85 and 86. The first page 
displays first-SAT and second-SAT scores for students coached 
at SHK (OOIA). The second page displays first-SAT and 
second-SAT scores for students coached at Test Prep Centers 
(022) .„ 

Pages 87 and 88 compare verbal SAT scores for coached 
and uncoached students. These comparisons suggest that 
SHK (OOIA) is effective although Test Prep Centers (022) 
offers minimal benefits. 

SHK (OOIA) shows a fairly constant increase over the 
entire PSAT range with average conditional SAT second verbal 
scores increasing from 43 to 39 points. Test Prep Centers 
(022) shows increases of 1 to 7 average conditional verbal 
points over the entire PSAT range. 
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16) SAT math scores for 2::aine tal^ 
* ' • • • exams 

■ Actual SAT math scores for 2-time takers coached between 
exams appear on pages 91 and 92. Page 91 displays first- 
SAT and second-SAT scores for 2-time takers coached at 
SHK (OOIA). Page 92 shows first-SAT and second-SAT scores 
for 2-time takers coached at Test Prep Centers (022). 

Pages 93 and 94 compare average math SAT scores for 
coached and uncoached students. As was the case with verbal 
SAT, these comparisons suggest that both coaching schools 
are effective, and that SHK (OOIA) is the more effective of 
the two schools. SHK (OOIA) shows second average conditional 
math increases between 22 to 76 points from the low to the 
high range of PSAT scores whereas the control group shows 
iPjteases of 1 to 35 points. SHK therefore shows a net bene- 
fit for second-SAT math scores of between 21 and 41 points. 

Comparing results for those who were coached before their 
first SAT and those who were coached between exams suggests 
that coaching and SAT experience confer sliyntiy different 
benefits. Coaching without SAT experience appears to help 
low-PSAT students. Exam experience with or without coaching 
appears to help high-PSAT students- and coaching after an 
exam appears to help everyone. Possibly, this may mean that 
commercial coaching tends to stress basic skills and remedial 
learning, while not emphasizing the more difficult portions 
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of the SAT; however, high-scoring coached students with prior 
SA* experience may be able to integrate their coaching lessons 
with the requirements of the more difficult parts of the SAT. 



i'jo 



90 



I * { a J 

— i X ••• • i 5 

• iX .1 

t • I ■ S 
I S i 
^ « .1 ^ 

k!;; .t.to .*.<o t,. 

K.eo 2».50 ,^^^1, Score* 

rSAT -nd flr«t-SAT mAth •co»^<« 
for 2-tJc;e wker« coached at OOM 
betveen S^T ex*m« 



Score* 

TSi.eo 



fts.ie 



CST.IO 



4SS.II 



— - - : ; t 



SATM2 = PSATM(8j9) + 118-7 
N=155 




rSAT l»«lh Scor«« 



rSAT ind •tc<*ftd-SAT puilh ttort* 
lor 7-ll»« t«>«i« cn«cli*d *t W)lA 
Wiwean SAT sxami 



SAT 
Scottt 




12.60 >''80 rSAT Math Scorci 



rSAT «n(J flr.t-SAT r*th 

lor J-iloe l«k«r» co«ch«d «t 022 

between SAT cXKoa 



SAT 

Kath 

Scorea 




rSAT and lacMid-SAT mth tcerat 
for 2-tlMa taWcra coacliad at 022 
i«t«»tan SAT 'l^*** J Q 

92 




X> 40 >0 40 70 to 

rSAT lUiti Scores 



•r rSAT Mth icortt. c«»H'l>^ft 2.ltBt l«ktr« co«cli«4 




(7) SAT a^time takers coach^ 

This final section of SAT results displays and compares 
second-SAT scores as a function of first-SAT scores. Actual 
first-SAT and second-SAT scores appear on pages 97-99. 
Page 97 displays verbal and math scores for uncoached 2- 
time takers. Page 98 displays scores for students coached 
at SHK (OOIA). Page 99 displays scores for students coached 

at Test Prep Centers (022). 

Pages 100 and 101 compare coached and uncoached students. 
Each diagram in this comparison contains a "breakeven line- 
representing no change between first and second SAT exams, 
in effect, for this set of diagrams, the study baseline has 
shifted forward from PSAT to first-SAT. Once again SHK (OOIA) 
is clearly effect-'e, although the case for Test Prep Centers 
(022) seems somewhat marginal. 

using the first SAT score as the independent variable the 

following results can be shown: 

/.I QHK fOOlA) students' second average SAT verbal 

(a) SHK (OOIA) 42 to 24 points from the low 

scores ^^<'l^''^^Jj°^ l?_st SAT verbal scores above 
to the high range o£ iirst &ai veiwax 

the control group; 

fKi QHK fOOlA) students' second average math scores in- 

(b) SHK f°°j;i^^5X°to 44 points from the low to high 
ValTe ot Tult SAT'ma?S scores above the control 
group; 

verbal scores; and 
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T*at Prep Centers' students (022) show second 
average math SAT scores changing from +7.1 to 
-5.4 points compared to the control group, fr 
the llw end to high end of the first-SAT math 
Bcore range. 



96 



•it.M • 



SAT 



llt.tl 




ttt.M 



271. ae 



Second 
SAT 
ttoth 
Scertt 



SATM2=SATM1(.8^) + 
N=78 



Mt.tt 



tM,tt • 



ltS«M • 




$U.i% lll.tt 



EKLC 



99 



SAT i-ifc "r** >*u«« 



SAT Itoth 




*AT «^tr«t* vtrUl tcerci f©r ■•cond-$AT a fwicllM •f 
flril-5AT verUl ■core*, cvsptrlns 2-tlBt itkcrt cmcIi«4 
At OOU bcWccn SAT •xmm§ v|th wicMcticd }.ltMt ttktrt 





ZKl averite vcrbil ocoret for •econd-SAT «• « fincclon 
of flr»l-iAT verUl icorei, conptrlng 2-tlc.e tiker* cot 
«l 022 b«tvccn SAT exAa« vlth uncoached 2-tl»e takert 




B. THE LAW SCHOOL ADMISSION TEST 

(1) LSAT scores for white and non-white 1-time takers 

As a prelude to the analysis of LSAT coaching, this pre- 
liminary section indicates why the effects of coaching are 
estimated using LSAT scores for whites only. 

The first part of this section displays LSAT scores for 
uncoached white, coached white, uncoached non-white, and 
coached non-white 1-time takers of the LSAT. Comparison of 
average LSAT scores for these groups reveals two major dis- 
tinctions: 

fa^ Whites, whether coached or uncoached, perform con- 
siderably better than non-whites, whether coached or 
uncoached, having a similar GPA. 

(b) Among whites, LSAT coaching appears to benefit pri- 
marilv those with a lower GPA; among non-whites, 
LSAT coaching appears to benefit those with a higher 
GPA This LSAT coaching impact for whites appears 
repeatedly, suggesting that LSAT coaching operates 
bv refining or renewing some basic skills. But ir 
this is so, it is not clear why higher-GPA non-whites 
benefit more than lower GPA non-whites. In any event, 
there appears to be a distinct difference in coacha- 
bility between whites and non-whites. 

Amplifying on the foregoing, uncoached whites with a 
GPA of 1.0 (on a 4.0 scale) have conditional average LSAT 
scores of 436. Uncoached whites with a GPA of 4.0 have 
conditional average LSAT scores of 640. Uncoached non-whites 
with a GPA of 1.0 have conditional average LSAT scores of 313 
while uncoached non-whites with a GPA of 4.0 have conditional 
average LSAT scores of 531. 
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•Coached whites with CPA's of 1.0 and 4.0 have condition- 
al' average LSAT scores of 458 and 634 respectively. Coached 
non-whites with CPA's of 1.0 and 4.0 respectively have condi- 
tional average LSAT scores of 301 and 556 respectively. 

Oncoached whites score on the average between 123 and 
108 points higher than their uncoached non-white counterparts 
with identical CPA's. Coached whites score between 157 and 
78 points higher than their coached non-white counterparts 
with identical CPA's. Coaching prior to taking the first 
LSAT appears to widen the white/non-white score gap at the 
low end of the CPA spectrum but narrows the score gap at 
the upper bound of the CPA range. 



103 7 



LUT 



•••••• • 



I 

.... 

t 



tSl.tl 



•••••• 



!LSAT=GPA('67,8)^ 



I 

. I 
I 
I 

' I ' 
I 

' I 
^ I 
I 

■ II 
•I 



■ • 



* 1*1 * *l * • 

• • •• • I }«•} 4-.**!U««;« 1-1 
• ■ • Is* •|«}?}t.Mt:M.* 1I2I4IM-I 



'I ■" 



fit-tt • 



; N="18794Y 



'^tl'^^tl9%'i9%%^Ml''^ 



^ ^ I J.. ns>Mj:iM*:»»*i»»i»»>»« 14*$ 

II nil |*lMU»*»V>**^»M«»»»%»»»«t»»»»»»»»«4*»tt»»«»4J*JIII 

i«»»:.-.» J o*i^^<^«fMt»»5»n I •»i»»iia»»*;4*:i 
■ ••-wir*j7 i j.*' ••i>»»»:»»i4i:»»»»»»«»»^»»»'»t»»ti?t.u::i ■ 

i.|.iii;-i>><;:tMi43?»i»»»«^»»»«*« >4»Hiii>. !■ 
I • ?«Mrj»**7»:>»ist*4jM,Mt»sM:;. * i« 

'•I 1 -i • 




*j •'i>.:^:*^s.''!l5M;•<l»•,i1-t»♦»•.l•*s.••i•^:^-^- 



I I iii.«»:»»i>t*i ■;:»»»4* i>» ii-'J i J 



119.10 • 

- - I 

I _ 

• . J 

I 

I 

— ••■ I 

I 

" I 
^II0.II.,» 

I.SD 



J 

• l« 

• I 

l« 

T~ I 

• I 

X ■ 

• 1 

■ I 

I 
I 

• I 

r".«"-ii-«- — — 

|.<f 1.10 



• i •)•••>« >^ 21 >>: 

• ■ 22* 2*2 ■■■•« 

9 ■ ■ } ■ S «2 

I l-l • I 

■ In 

• » ■• 2 • 



>i *»l 

I • •■2 
i;«b42 * 

I I-I2": • • 



LIS 



• 1 • 


I • 


• 1 • 


• 




1 


•■l« • • 




• 




• 


1 


1 ■ • 


i 


l« 






« 


•1 

■ ■ 


1 

1 • 

1 


■ 

• 






1 
1 
1 


■ 


!• 


• 






1 


■ • 


] 








• 


I.TI 




s.ot 


1.^0 


1.0) 





CuauUtivc CPA 



LSAT ■cortt for vhllc wCMchcd 1-tlme takers 
■ ■ ■ fmcllon of CPA 



ISAT 
Scores 



V4s:io ' • 



I LSAT=GPA(58^.7)_ 
"+'399-2 




« 

■ • ~ I 

1 

I " 
I 

1 * 
I 
I 
I 

I ■ 
I 
I 
I 

!• 

I 
I 



I 
I 
I 
I 
I 
■ 

l«a 

I 



I • 



41 



' " ■ • • !■ ■ "I • I vl* 

I 9 |»«ill» I al • S 
!• •! yaia*}* ■ 4 •■■|aa2*a • 
mm ■•«• sis -S ■)« 4S1 l»« "41 • 
■ • S * IIS)**** l*2ll* 

<« • • i i ■■2))))5- HI«|2I22-T«-1 S 

•■S* "I"! ISI*IS2*;*)*S«t**I> «I«ISS*>I2* 1 I 



2 "I 
• • • 

)2« 




S«l 



• } ■ mtl ■ •) II* lt*S**S2«*«2 S IS* 

...}.» ••.*|J — •-|«l»l*M— J2S«-4li-*^ 

I • )«2S*I*)I**I-I* I 

■ I2l«i II** «i««JXA**«T.*«l«:il»l«l» ■ ■ 

I •■! ■ •!• I^T^i*!^*^*"" I«I24 l"lll "I • 

• ■} •! • |2j>«-rT"'V 1*5 -ll*" ■• J22»»:J»«««« •II2» 
■ ■ • »>>«7?I2« ■■■I • ■•■■•22**l***l* I* 

^^|« • ll« |)}2«S2II« l«l 

•}• • • ••«! I ■ ■•)• I • ■ 
!!■ II |«*** • • •! I • I 

II ■ I I II* II • 
■ I *• '• • mmi mm till ||« • ■ • 

!»• I • • ■ |>« a I ■ ■ 

!• a I ■ • • 4«l t 

••• ■ 

• • mmi • a I ■ 
9i m •! I ' l" " ••" 



; 

^ ^ I 

I 



lll.'ll • • • 



l.tl 



l.lt 



l.tl 



I 
I 

!• 

I 

I 

t 

I 

I 

la 

I 

I 
I 
I 
I 
I 

V 
I 

•••• 



• • I 

■ ■■•■|a ■ • l> ■ ■ ■ 

I ••• 

• ' ■ ■ ■ ■ t 

■ ■ ■ I I ■ 

• I • • 

■ ■ I ■ ■ 

■ ■ I 
■ ■ I 
• • • I ■ 

m m m m I 

• • > 

mm • I 
■• I 
I 

I ■ 
• • I 

I. II t.«4 l.lt I.I? riS 



l.ll 



iSAT leerti foe cMcKa4 «r|«|i« 



•r CPA * ^ 



CwtuUtlVa CPA 



t.ei i*to l.ss }*«o i.t? s.<i 4. CO 

CuauUlive CPA 

LSAT 'tcocf for incMChed nonvhlle 
l-lUic lal;cra & finction of Cl'A 




1. 11 





-•-«.«.,•, 


t 


«« 


t 


t 


t 


« X 


t 


1 ■ 


t 


1 


1 


* « 


1 


1 


t • 


1 


I 


t 


t 




• 1 


■ • • 


■ fe • 




2 1 


• t 


■ 1 




t 




t • 




• t 




1 

la ■ 


^^^^ 1 
'^'^ 1 




• • t 


1 


t 


1 


• ■ 1 


• 1 • • 


* • 1 


t k 


■ " • 


Z 


• t 


t • 


..... J 


B 


t 


1 


1 


t 


• 


1 


1 


t • 


a t 






t 


t 


1 


• 


1 


1 


t 


1 


1 


1 


1 • 


1 


1 


• 


1 


1 


1 


• t 


1 


1 


1 


1 


1 


• 


it 


1 


1 


1 


1 


1 


1 


1 


• t 


• 






l.ll 


1.44 S.ll l.t? 



105 



120 



{2) iSAT scores for uncoached white and non-white 2-tiTne 
• " takers 

This part of the white/non-white LSAT analysis displays 
LSAT scores of uncoached white and non-white 2-tiroe takers. 
Comparison of average LSAT scores for these groups leads 
to the following conclusions: 

(a) On the average, both whites and non-whites display 
improvement on their second LSAT attempt. 

(b) This upward shift, which is larger for both groups 
as GPA is higher, may represent a "learning effect"; 
that is, actual LSAT experience provides information 
and exam familiarity that are translated into higher 
scores on the second attempt. 

(c) Whatever they actually measure, GPA and LSAT appear 
to measure somewhat different things; this differ- 
ence is implied by the relatively low correlation 
between GPA and LSAT scores. However, increasing 
GPA presumably bears some relation to demonstrated 
ability to learn; the same ability to learn which 
leads to higher GPA may also lead to the higher 
score gains associated with a higher GPA. This line 
of reasoning suggests that the LSAT is "learnable" 
even by uncoached students. It also suggests that 
students with greater ability to learn in general 
will find the LSAT more "learnable". Finally, be- 
cause intergroup score differences grow with in- 
creasing GPA, it may be that whites find the LSAT 
more "learnable" than do non-whites. 

Uncoached white 2-time takers of the LSAT show an 
average LSAT score increase of 9 points at the lower bound 
of the GPA range and an increase of 50 points at the upper 
bound of the GPA range. 

Uncoached non-white 2-time takers show average increases 
from their first to second LSAT of 13 to 36 points ranging 
from the lower bound to upper bound of the (jPA. 



107 



LUT 



fll.li 



•LSATl=GPA(4&.2) 
! .+ 363.8 



I 
t 



tic.ii . • 



I 



I 
I 
I 
• i 



•I 



I 



I 
I 

I 



I • • 
• • I 

• • 1 • 

!• •! • t •• • « 

a a I • ••• I • t • I •••It • •• • • I 

•••I •! • •! t|«*}}* •}•••! • I* "i 

• • «t •! Itl«<f« ■ 1} }l •••t 

• I •i •% II I I ««a)l*ll«llira« l«*a«|a«i 

m m t • ••21 >• "^^tll^l* l*l* l«« * 

•• !• ••}• • •: !•« •c;««Ji.ii «;«i*iitc>«: c<«'.«:*iii • •! 

I 11 111 i>?«ii*S'> •i«si}>«»ft«««i»«7««»%t»«tc%? jt.*«%«>ic«4} i;i 
•I • ••• • ;it?risii«isi**^9«*>ii'*t*^^^*^*-^s* va^*;**! 

l« }j • 4;»»c;:»iJ*u»»»«*»»*li»«-«;i:»»*'«'**»3i«»*«/ii%%* il 

•• ij: •f«i;ii:**: ••is«*<«<*i«»«T2^ ■! 

I • • ft i*i*:i;»»::ii;»»;:M»f;>*-^rm«M<.>;<.n««Mis -ir; -u* • 
• « •!••« I I II I III I iM'^Ti Hi' I I'Hi I 111 n 1} • !■ I 

• ••• •! ..tl!«>!i>--"<rr77-i*Jli4:i*ttJMir»|**f «-l*j|.M2 II • I 

• i# I 2 ••♦i«i>-w«-rrr7A;«^»*7i«»»»»«J*«»i'»«?*«**»«*2»*te^i2»ii«« I I 
I I •.ivp-----5?tiii»ii« 1 *c*ii»rji*»»ti»*»«»iii****i**i «i*>i« I I 

^^^^I'-ixj* I «• *'.».;i:ri»«»i*T»"*»J4»»f«fc*i»»;i»»*** :ic»2i-2 • • 

I I •! i*j»,-ri«»i»i»r*:n«»i*'i****'***i»2<i»ii ■» • i 

I ■■• • i?«»7*i«*»:>i**»i ics-r-^ti^fizi^f^iai*** ■! ■ •III • I 

■I • i*s«* •««i«;;i«i";:i'i;iii?%**ii?**2«ii<*;;i«2i*2i* fZ!2 • • i 

• ••4.'.| 4i;j»«;:»»r»l5l»ll.'C«l-li****-"ll "ll-l • •! 

■ •Jill It ii«<;i 2*«ci*:»i2«i i»« • • • • 

mt •i I III! 2i:>:*»;4*»;:»i*J i:i2c*i»i "i • • •• • i 

• • I •■}«2I12*** »»»2 •••»! 2»* • 'il • • • 

,.«.■• — «-••-• — •- — •-• •J2lll-l-»l-l—2»* II >2«« — -•-•-•l"™*——^-l 



• I 



til. 41 - 
I 
I 

---!• 

lift. II • 
t 
1 
I 
I 

ISt.ll • 



I 
I 
t 
I 

««l« 



I • 
■ • 

I* 

I 

I • 

I 

I 

••• 

I 
I 

I 
t 

I * 
.1 
I 
I 

I- 



• 2 l« •2al*l*l** 

II mmi I 2«» •i* 

•I • « • |a 

III •■|a|a*« • II • 

I • t II 

• • •••• I • • 

•|«> 



I « 



I • 



1.14 



'i!ii 



ft.«l 1.71 
C«aaul«llvc CTA 



LSA7 flrll-icore* for tneoachtd whl(« 2*tlB« taken 
4 funclloo of CrA 



LSAT 
Scores 



I'LSAT2=GPA(61.4) 
To.M I + 359.6 



.U=572a. 



III. 11 • .. 
I 

I . 
I 

I 



I 
I 
I 
I 
1 
• 

I 

••nil 



• • ll« I • I • 

• ■ • • !•• I •%• A -I 
■ •»• I •«|«l««l nil • II* 2 
■fa«|«|laa*«*l««l*ll* 

•!• 



9 i« •411 I 



1 • • • I I* ••■•II •••l*l*M J2JIIIWIII* I 

, . I «.••!• • -l-ll •*! .llftl*^2^;--*^>*l • 

• i.. i««i i.i-«n4i*i*M-ii">»**2»*»»>«»***' ijtv.vr 

.1. ■ !• III-. I II l*.*»c.lf4ll*M^•*44l**•»^llll i. 

' |}l.«.|MlM|}llftlft2llW«2tl4« •I^- l» 



<4ft.l 



I 

I 
I 

Ml. 11.. J 

I < 

I 

t 

III. II • 

. . ....J 

I 

t 

1 
I 

I 

•11.11 • 
I 
I 

Ill.ll • 
I 
I 

• • I 

1 . 

Ill.ll' • 
I 
I 
I 
I 



. I 
• I 



.til I II >.i».oi:i»»»»i-»»'»»'t"""j;»''"-";';"*: 
.. , iiM.i.u. ..w"-!t-!"?"»ii"t:i?:::; riJ " 



..•l« 



I Iftl. |.> :.II *Mlil-»M4f«*»4*lMCSf*MM»t»;5M»^ 
• .■•|aa*}aaa|14l] 

•iJ i^^..iii^i2;-M4»iwi-wfMM4»«t;i;>^^ 

^ .. iilifii M-U-iiii^t^tMiTi i«4i«M««ftUM«*u»2«*iiM» i*»i«i 

, i« . ili^w^l2Mli.:i:.»o*Mit*w*«*«Mi«***itM*i%-;i*-s» 1^ 

• ^5%|1K l-.-ll ||IIJl.*.M*f4*M4IJM*l*J46***l»*lll.|l*lfl«l 

■I ••• l«lll* I.** 4*|.4»***»llf-»*»2**-**l42* 1*1 »»• , 

i! " M; ...I ii..4i*iiii%4»»»ii4*i*i-isai>'»;"» •I • I 
i ••! I II.. iM III .».•»*. ' 

• I alll •.•41. 21/41 |«4..|.:4l*** III?. I l» 
• I I |.« I •.•II .|4. 1141. If .11111 *4.|»4|. 114. 

,.-.I...!i—i»-i-i».iii»*-«-i—-n—«"**"-"'''' 

• • I l« -I • • •! • «••• ••• • • •• 

• |>*a« Bl 1*1 |.««« 

ai •• ||«|* • 
I • !• ■! • • 

■ • al I • 
«. • • • • 

• • I • 

I • 
• •I • 



I 

• I 

• I 

I 

l>* 

I 

• .1 

• I 
• I 

1 I- 

I •! 
2« I 

..I 
••I 
I* 
I 

r,|.| 

II t 
... I 



• • l« 



• III 



I • 







|«B 1 «JIIII' 


• 


1 1 


l« 1 l*««l 


• 


• 


«|. « 1 •.• 


• 


1 1 


• «• • • 


• 


• ••• 


• •• 1 


1 


!• 


1 • 


1 


• 


• 




1 • 


• 




1 






1 


• 




1 


• • • 




• 


• • 




1 






1 • 




• 


1 





l« • 



l« 



111*11 • 



,11 t.ll t 



I. It 



1.14 



• I 

I • 

. • ! 

• I 

• I 

I 

••«•••.••.•••••• 

I.tl 1*11 



I I 
I 
I 

• X 

I 
I 
I 
I 

• 

I 

• I 

—I 
I 

• 

I 
I 
I 
I 

• 

i 
I 
I 
t 

• 

I 
I 
I 
I 



1.41 l.fl «.ll 

Ctfvutlilvi CfA 



41 • fincilvn •( Ci'A 
108 



oktri 



I 
I 
t 

t 



LSAT1=GPA(45.7) 
+ 283.8" 



Mia* • 



I 
I 
I 
I 
I 
I 

• I 

• I 

I" 
I ■ 

I 

!• 

I 

■ I* 

I 

•* I • 

• • f* 

1 11 
• •« 

mi I 

• I 



■ ■ • 
■ 



* ■ • 

• ■ ■ • t 
• ■ ■ 



I 
I 
I 
I 
I 
I 
I 
I 
I 

!■ 

• •I 

I 

I •• 
!• 

• I 



t 
I 
I 

- • I 

1« 

I 

' 1 
I 

I 
I 
1 

s 



• •• • !• • 

• I* II* t«t • • 

■ • ■ • ••! • • 

• I • • I • 
i , • •« «• • • • • !• I 

Urn -IJ I • • •••• ■ 

!•»• • •••|««l« • • 

•I l« • • !• • 

■I I "I ••2 II** • • • •••• ' * 

I « J ■ • mf»»^^^^JJ^ 

t ••l«*l* •••• m •<* ' 

, . .••_;^^*-.-rrr^i I . • ;•• -i * 

• • II I l« I" > • 

• I • >• • II •!! • • I • « 

.J.J— •--••••••I— 

• • IS • 1 

• ■ f •« • l« "I 

• ■ • 




1 >l 



■ I 
■ ■ 



189. «• • 



;i2 



I* • 
I ■ • 

I 

■ ■ • 

I I 
I* 
I 
I 

■ • I 





■ 


• I 1 


• •i • 


• 


• 


■ ■1 


• 


• 




1 


1 


■ ■ ■ • 




1 


I • 




1 


■ 




■ 1 


■ ■ 




1 






1 


■ 1 




m 1 


■ ■ ■ 


1 


. t 


■ ■ 




1 






1 




■ 


1 


■ ■ ■ 


■ 


1 



LIS 



t.ll 



l.l« 



1.1? 



1. 10 



S.I? 



S.ftO 



tSAT flr«t-«eore« for weoaehed nonwhlte 
2.|iBc takers • fwctlon oi CFA 



LSAT 
Sc«t«a 



ERIC 



114. •• • 
I 

I . 

I 

S 

I 
I 
I 
I 

CtS.II * 

I 
I 
I 
I 



•LSAT2=GPA(43.7)j 
+ 302. B 



« ■ 



I 
I 

!■ 

I 

I* 
I 

II 
I 



■ I 

tm 
I 
I 
I 



MI.4I 



■ I 

t • I 



•■ft 



I — 

I 



«SI*II 



I 
I 
I 
t 
« 
S 
I 
I 
I 
• 

I* 

I- 
I 

lll.tl " 
I 
t 
I 
1 

•••••I • 

I 
I 
I 
I 

•»•.«§ • 

1 

I' 
I 
I 



■ ■ 



« ■ ■ i 

■ • al I 

■ ■ ■ ■ ■ ■•III 2 

a ■« • ■ ■ 

■j« ■ • • !• ■ 

■ ■ ^ 

...J-........ . • • 

m ■ aal 

■a. ■ ■ • l« I • I " ••• 

■ ■ ■ • |«a I si* • > 

mi m m I t I'll • " • 

a ■ !■ • * *l> * " 

«t ■« • mim m |a«|Bi I I ? 

, J 4 • I II* _-Z.^ i , 

^""^^s I •••••• •••• • • ••• ■ 

s|jj ••■••I l»«l • II I* • 

■ % • ||«**l«« ''I • ■ ■ ■ < * 
J I • • • 



■I • « 

js 

II 
I 



■ I 



a. ...... J 



II ■ 
■■• ■ 

t ■ 

■ ■•■ 



I 

■ I 



a ■ ■ • •••• I ■ • 

■tat • •• • • ■•! 



a ■ 



••••••••••• 

«.|| t«M 



•I 
I 
I 

■ ■ 

t 

■ I ■ 
I i 
I ■ 
• I 

I 

I ■ 

I 

U 



• I 



t.l? 



I ■ ■ • 

■ ■ I 

■ t • t ■ 

> t ■ ■ I 

•••• ■ ■ I I ■ 
■ ■ 

■ ■ I 

I I 

- 1 
I 

■ I 

t 

i.n i.ti 



S.ll 



109 



CiAuUlUs CfA 



LSAT 
Scores 



H 
H 

o 




Vhlte LSAT 2 

I 

t 

white ISAt 1 

honwhlte ISAT 2 
nonwhlte ISAT I 



1.0 



1.5 



2.0 



2.5 



.3.0 



i :3.5. M 
CunuUtlve CPA 



ISAI .ver.8e scotei to mmM Ukt tAe« .. . fwtlon of CP*i 
c»p.rln8 vhlt« flr.t.lS4I .e««, MM Seconal .««., 
nonvhltci flret-lSAT scores, mi nonwhltes Mcotid-Wl icorej 



127 



(3) LSAT scores for whi^ and non^^ 
" '■ ~" Between exams 

This part of the white/non-white analysis displays LSAT 
scores for white and non-white 2-time takers coached between 
exams. Comparison of average scores of these groups, and 
also comparison against uncoached white and non-white 2-time 
takers, reinforces the conclusion reached earlier regarding 
the 1-time takers that LSAT coaching tends to have its 
greatest benefits for low-GPA whites and high-GPA non-whites. 
Despite coaching, marked LSAT score differences persist 
between whites and non-whites. 

For example, whites with a GPA of 1.0 coached between 
administrations of the LSAT show score increases of 40 points. 
Their non-white counterparts show score increases of 2 points. 
Whites with a GPA of 4.0 coached between exams show conditional 
average score increases of 51 points. Their non-white counter- 
parts Show conditional average increases of 65 points. The over- 
all effects of coaching for 2-time takers of the LSAT based on a 
comparison of this section and the preceding section may give 
th.. impression that at least in this category (2-time takers) 
coaching has at best marginal benefits. However as we will 
demonstrate when examining individual coaching schools in 
an unaggregated form, this conclusion is not warranted for 
for all schools. 
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14 5 LSAT first and second scores for white and non-white 
■ 2- time takers 

This final part of the white/non-white LSAT analysis dis- 
plays and compares second-LSAT scores as a function of first- 
LSAT. scores. Shown are LSAT scores for uncoached whites, 
uncoached ncn-whites, coached whites, and coached non-whites. 

The first set of comparisons displays differences be- 
tween uncoached whites and uncoached non-whites and between 
coached whites and coached non-whites. In both comparisons, 
whites outperform non-whites, with greater differences appear- 
ing at higher first-LSAT scores for the uncoached groups and 
at lower first-LSAT scores for the coached groups. The second 
set of comparisons reveals that coaching is more beneficial 
for whites in the lower score ranges than for non-whites with 
similar first-LSAT scores. 

This study does not attempt to explain these persistent 
differences in LSAT scores. We appear to have an effect with- 
out an identified cause. However, to clarify subsequent com- ^ 
parisons among LSAT coaching schools and between coached and 
uncoached students, non-whites are excluded from the remaining 
analyses. Such exclusion allows subsequent analysis to com- 
pare relatively more homogeneous groups. In addition, rela- 
tively few non-whites enroll in coaching schools, so that data 
are too sparse to rigorously evaluate individual coaching 
schools regarding the extent to which they benefit non-white 
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students. Uncoached whites with an initial LSAT score of 200 
show score gains of 63 points compared with -average gains of 
96 points for th«ir coached counterparts. Uncoached whites 
with initial LSAT scores of 800 show theoretical gains of 9 
points compared to theoretical decreases of 2 points for their 
coached counterparts. 

Uncoached non-whites with an intitial LSAT score of 200 
show average gains of 50 LSAT points while their coached 
counterparts show average gains of 71 points. Uncoached 
nofi-whites with theoretical intitial scores of 800 show average 
decreases of 10 points whereas their coached counterparts 
reveal average decreases of 32 points. 
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(5) LSAT scores for 1-tiine takers 

This section displays actual LSAT scores for 1-time 
takers coached at various schools against uncoached 1-time 
takers. These comparisons reveal that: 

(a) Stanley H. Kaplan Educational Center:. iZi^n (001) 
provides effective coaching for the LSAV; 

(b) All coaching schools seem to help low-GPA students 
more than high-GPA students; 

(c) The Amity Review Course (Amity) (002) and John 
sexton's LSAT Preparation Center (Sexton) (003) 
appear to be marginally effective at best; and 

(d) The LSAT Review Course (Evergreen) (004) and a 
composite of small coaching schools (005-021) 
appear to be effective primarily among low-GPA 
students. 

The following table reflects averag,e conditional first 
LSAT scores as a function of CPA for those individuals coached 
before takir.g the LSAT and for the uncoached group. 
CPA 

Uncoached 

001 

002 

003 

004 
Others 

The greatest net benefit is shown by Evergreen's increase of 
49 points at the 1.0 GPA level. At the 4.0 GPA level only 
SHK shows an increase and that of only 8 points. 
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(6) LSAT scores for 2'ttme takers coached before first 

This section displays actual first-LSAT and second-LSAT 
scores for 2-time takers coached before their first LSAT. 
These scores, together with comparisons between coached and 
uncoached students, are shown for individual coaching schools. 
These 'results suggest that: 

(a) LSAT coaching is primarily effective for low-GPA 
(white) students; 

(b) SHK (001) produces be^er results than the other 
schools; and 

(c) It appears that the benefits of coaching may be 
somewhat ephemeral; in most cases, the uncoached 
group improved its relative position on the second 
LSAT exam. 
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(7) LSAT scores for 2j:yjH 

• This section displays first-LSAT and second-LSAT scores 
for white 2-time takers coached between exams. Comparison 
of average LSAT scores for coached and uncoached students 
reveals the following: 

(a) Amity (002) appears to offer the greatest benefit 
^SJ high-GPA Iludents, whereas the other schools 
seem to be marginally effective with Sexton (003) 
showing a score decrease. 

(b) Evergreen (004) appears to be i^^^ffective for 
low Scoring GPA students whereas all the other 
schools appear to be extremely effective. 

The following is a table of first and second LSAT scores 
as a function of GPA at the 1.0 and 4.0 levels for the coach- 
ing schools we have analyzed. The uncoached group is also 
included: 

GPA 

1.0 4.0 



001 LSATl 
LSAT 2 



410 534 
464 586 



Wl LSATT 302 580 

LSAT2 364 _ ±±1. 



003 LSATl 
LSAT 2 



467 524 
502 568 



LSATl 



TTT 515 



LSAT2 414 569 

354 536 



Others LSATl 

LSAT2 402 591 



Control LSATl 
(Uncoached) LSAT2 



4T2 556 
421 605 



The composite group of small coaching schools shows gross 
average conditional LSAT increases of 55 points at the 4.0 
GPA level, Amity (002) shows a gross average conditional 
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increase of 65 points. The corresponding control group shows 
increases of 49 points indicating a net benefit of 6 LSAT 
points at the 4.0 GPA level for the • compos ite group of 
schools and a net benefit of 16 points for Amity (002) 
students. Although these increases are small compared with 
the dramatic incr-ases reflected in SAT scores part of the 
apparent minimal effect is accounted for by the extra- 
ordinarily large increases in the control groups. 

At the 1.0 GPA level Amity (002) shows score increases of 
62 points, SHK (001) shows score increases of 54 points and 
the control group shows average conditional score increases of 
9 points, indicating a net benefit of 53 score points for 
Amity (002) students at the 1.0 GPA level, and a net benefit 
of 45 LSAT points for SHK (001) Students at the 1.0 GPA level. 



139 ^^7 



rirti iii.tt • 

LUT 



Sll.lt 




Cinulatlve CPA 



tSAT firit acorea for ?-tIce taktra aa • function of CPA 
lor wl»lt»a ccAChed »t 001 between exAaa 



ISAT 
Scorea 



KI.U 



Ml. 19 



III. II 



IIKm 





at * 


! •• ■ ! 

! LSAT2=GPA(40.7). j 
1+423 ! 


a| 1 
1 • 1 
1 • . ■ * 
• S • 
1 • 1 

• 1 ■ • 


1 •N=15a S 
1 • ■ • 

1 ■ 


• al aa • 

a 1 ' 
a 1 a • 1 
a 1 ' 


1 1 * 

1 

I a 1 ■ ' 


a 1 . a a 
1 a a • •! 


1 " " " I • 
1 • 1* 
• a ■■ ■ 
1 ■ a a 
|a at 1 ■ 


• a 1 a • ■ t 
a 1 • ■ i 

a t a a ■ ■! ■ 
a a 1 aaa ^^^^^^^^^^""""^ 1 

a ■ — • 1 


la 1 > 
1 a a a 

• a 1 •^.^^ 
1 • 


•j^* 1 a a 1 
^ • a 1 • ♦ 
1 • ' 
a a a 1 • > 


1 1 • 
1 a^ ^ a 1 a 
1^ 1 


a a 1 a 1 
a a 1 1 
aa a a| a • • 


• . 1 
1 1 
1 1 

1 " * 1 a 
« 1 • • 
1 taa 


1 1 • t 
aa 1 • 1 

1 a ♦ 


1 1 

1 • 1 • 

1 • a « 


i ' 1 


a 1 

1 1 
1 a 

1 1 

1 • .1 

: ^ { 
1 • i • 

1 1 

« a • 1 


at* 1 

at' 1 

M , t 1 
• t J 

■ 1 ■ 1 


i.ii i.ii f.i« i.vi t**i 


I.I? S.I4 S*l> 

CttftutaLlv* CrA 



IIAT aacoo4 icoti* for t-tUa tak«ri •• • funellwi •! CPA 
lor vhlUa co*thad at 001 Utwaan aiMi^ 

An CJ 



140 



LSAT1=GPA(92.8) 
+ 209 



Mf.ii 



441.41 



III. II 




I. II 



1.51 



LSI S.17 S.V7 

CuaulciSve CPA 



tSAT first acerc* for 2-tlafi (aVcr* « function of CPA 
for «bltc« co«ch«d at 002 ketwcn 



i»can< ?ii.M 
ISAT 

l?§.4l 
111.11 


• 1 " ' 

1 LSAT2=GPA(93.4) j 

1+271 1 • 

1 1 

1 • . 1 • • 

• ; N=44 1 


1 

1 1 
1 t 
1 t 
1 1 
1 • 

1 • • 1 

1 1 

1 • ^« 

1 • ^^^'^^ 

1 • • ^^^^'^""'^ « 




1 1 

1 1 * 


1 1 
1 ^-^^ 1 
1 ^.^"^^ I 


t«1.t« 


* « • 


-rvT ^ 1 


tM.tl 

tit. II 

49t.4l 


• i .^^^^ 
1 1 ^00^ 

• ^-^^""^ ■ * 

1 ^-'''^ I • 

1 ..^"^ « 

I • 1 • 

1 ■ ■ 1 ^ 


1 . . • 1 

1 • 1 
1 • 

i 

1 • 

1 1 

1 • s 
1 1 
1 1 
• • 

• • — — -I 


ttl.ll 


1 * 1 
• • 1 
1 1 


1 1 
1 • 

1 • « 


H9.lt 
ttl.l* 
>I4*«I 


1 1 
1 1 
1 1 

; 1 

! \ 

1 > 
I > 

; - \ 

1 • > 
1 1 
1 1 


1 1 
1 1 
1 a 
■ • 
t 1 

S ' \ 

1 1 
1 • 
1 1 
1 1 

1 1 
1 1 
1 • 



^iX% nr**" i!ii «•»• «•»» 



LSAT ••renJ •cer«« for 2*tlA« t«k«r« «• • f««ctt«n CPA 

7^ tmt vliltac CMch«4 at 002 b«|v«cffi axcais 

^9 141 



rirat fii.M 
iUT 

••4.H 



m.tt 



•11.10 



4W.ie 



Iff .€9 



t • 
• I 
I 
t 

LSATl=GPA(18.9y \ 
+448 . j 

N==139 • i • ! . " 



I 
t 
I 
I 
I 
I 
I 

I • 
i« 

t 
I 
I 
t 
I 
I 
I 



■ ■ 




CwBulatlve CPA 



LSAT flrit aeortt for 3-Lir.e takers •« • function of < 
for vhltcft coached at 003 betvccn cxAoia 



Second 

iSAT 

Score* 



•70.19 • 



Ml. II 
491. 



4lt*9l • 



411.91 



m«i9 • 




1.99 



1.99 



1.19 



I. It I.H 
Cwwlailva CTA 



iSAT aacmJ acoraa Cor 2-1 Im takara a« • ftnctlen of CPA 
for wtilcaa co«ihait at 003 katvaan a«*iia ^ () Q 

142 



LSAT Urtl "Corel for 2-tlr.e taker* «■ « fxnctloa of CPA 
for «<liltea CMched *t OW between ex«a« 



Second 

VSA7 

S<or«t 



StI.fO 



•••••• 




ttf.it 



114.11 



>.it 1.41 >-tt 

Cinul«tlv« 



161 



tSAT -etood icor.. for l*kT« • tvncticn of CfA 

for vMl»« co.ch«a At COi b-lv«.n •xa»< 

143 



rirtt III. II ; 

iSAT 

lU.M 



IM.tt 



4?t.9f 



mz*. 
41T.I0 



I.SAT1=GPA(60.4) 
+ 294 

N«45 



I 
I 
I 
I 
I 
I 
I 

!• 

I 

I 

I 

I 

I 

I 

I 

I 

I 




WT.IO ♦ ■ 

• — — 

t.l» 



Cuauli 



Lift 

Clv< CPA 



LSAT fSr«t acorca for 2-ttine takera aa a fuvccion of CPA 
for vhltea coached aC oUicr achoola baCwecn cxaot 



Second 

LSAT 

Scor«a 



4tt«M 



•19. M 




LSAT aaco<vJ ac^raa for 2*ttaBa takcra^fta • fimc'tim of 
f»r whttai co«<lt«d at olhar aclioota ^at»«efi aaaoa 



144 



162 



rir«t 




too r-p 

r 



.1.. _!7j_i_!_i_ 



lOO 



400 



500 



400 



j: 



-i;"j±:i:r!T;;. 



» 

'1' 





too 



r 



! 



t.e 



i.s 



i.o 



.5 c 



A.O 



145 



(8) LSAT first and second scor^ for 2^^ 
"^^ between exams 

This section displays second-LSAT scores as a f.ir.ctlon of 
fifst-LSAT scores and comparrs average LSAT scor^.s by coachino 
school for coached ai-d uicoached students. 

All the major coaching schools SHK (001), Amity (002), 
sexton's (003), and Evergreen (004) - appear to benefit pri- 
marily students with initially low.LSAT scores. The composite 
of small schools appears to offer fairly uniform benefits. 
The influence, if any, of self-selection is somewhat obscure. 
If self-selection were dominant, then we would expect to see 
greater gains for higher initial scores for SHK (001), Sexton's 
(003) and Evergreen (004). Instead, the average benefits are 
larger for lower initial LSAT scoring students. Similarly, the 
composite of small schools shows an almost uniform average benefit 
while self-sel.iction would imply a greater benefit for lower initia] 
scoring students. Only the pattern for Amity (002) is consistent 
with the theory of self-selection. 

•i'his section is an alternative method of demonstrating 
score increases for 2-time LSAT takers to the preceding 
section. Here the first LSAT score is the independent vari- 
able and the second LSAT score is dependent on it. In 
the preceding section the GPA is the independent variable 
and both LSAT scores are dependent variables. 
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The following table shows average conditional (theoreti- 
cal) score changes assuming an initial score of 200 or 800 
for the coaching schools and for the control (uncoached) group. 

200 800 

III '"^ 

others III 

Uncoached +y 

As this table indicates all the coaching schools increase 
scores at the lower bound with Amity (002) improving scores 
on the average by 70 points above the control group and by a 
gross increase of 133 points. The least effective organiza- 
tions at the 200 initial score level are the composite group of 
small schools that show a net increase of 18 poinls and a gross 
increase of 81 points. . 

At the 800 level of initial LSAT score coaching would 
appear to serve little benefit or in some instances be a 
slight detriment. Of course ->ur concerns are not at this 
highest level of initial score because individuals receiving 
the maximum score on their first attempt neither retake the 
examination nor enroll in a coaching school. 
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.There is no one easy generalization that characterizes 
the effects of coaching for all the analyses we have dis- 
played. Furthermore the analyses exhibited in this document 
are only one segment of the approaches we have undertaken* 
As we have already indicated, exploration of the technical 
appendices is mandatory for total comprehension although this 
docum'ent can and does stand alone. 

The results of our analyses reveal that coaching is 
dramatically effective for the SAT. The LSAT, although 
susceptible to coaching in a general sense, does show areas 
where the effects are marginal, h^ we have indicted we be- 
lieve: part of the apparent lack of susceptibility of the LSAT 
to coaching is related to abnormally large control group in- 
creases and the relatively low correlation between GPA and 
LSAT scores. Furthermore the lack of consistency of CPA's 
both between and within undergraduate universities may be a 
contributing factor. Additionally we believe the gross 
score increases found when analyzing 2-time LSAT takers 
and using the first LSAT as the independent variable may be 
applicable to l-time takers coached before the first LSAT. 
This would greatly increase the benefits received from LSAT 
coaching. We hope to look into some of these areas in the 
studies recommended, infra . 
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C. CASE HISTORIES 

The case histories that follow are drawn from Technical 
Appendix M (Miscellaneous). Appendix M contains relevant data 
concerning all individuals who were either coached more than 
once or who took the LSAT more than twice. Technical Appendix 
M reflects testing histories of some individuals who have 
taken the LSAT five or more times and those of some individual 
who have enrolled in multiple coaching courses, occasionally 

simultaneously. 

Technical Appendix M is composed of the testing histories 
of those individuals v/ho have probably suffered the greatest 
psychological trauma from the law school admission process. 
They have in some instances spent ove'' $1000 in application 
fees over a three or four year period only to be rejected 
by every law school to which they applied. 

The probability of acceptance to law school appears to 
diminish with the length of time one remains in the "admission 
process". Therefore any acceptances to law schools of 
individuals whose data appears in Technical Appendix M 
are not only surprising but emotionally gratifying. 

The case histories that follow all have a portion of 
happiness as all the individuals ultimately were admitted to 
law school. They all were admitted after they had been 
rejected, gone to a coaching course, and increased their LSAT 
scores. Our study demonstrates that coaching is responsible 
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at least in part if not in full for the ultimate acceptance of 
all these individuals to law school. However, the fact that 
these individuals waited until they were into the admission 
process to enroll in a coaching course, rather than having 
taken a coaching course at the outset, may have caused them 
undue anguish and expense. They appear to have enrolled 
in a coaching course primarily out of desperation. 

The case histories that follow perhaps articulate better 
than any other mode, although in anecdotal form, the persons 1 
costs and benefits of coaching. 
STUDENT A 

Student A, a history major at Bryn Mawr College, with a 
GPA of 2.10, took the LSAT in December 1974 receiving a score 
of 531, and in February 1975 receiving a score of 565. 
Student A applied to New York University Law School, Columbia 
University Law School, Fordham Law School, Rutgers Law 
School, Brooklyn Law School, Hofstra Law School, and St. 
John's Law School, for the class commencing in the fall 
of 1975. Student A was rejected by all these law schools. 

Student A then enrolled at the Stanley H. Kaplan Edu- 
cational Center in New York for the course prior to the July 
1975 LSAT. .After being coached Student A took the Julj 1975 
LSAT and received a score of 665. 

Student A then applied to Columbia Law School, New York 
University Law School, Fordham Law School, Rutgers Law 
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school, Brooklyn I&v; School, Hofstra Law Schcol, and St. 
John's Law School, Student A we s placed on the waiting list at 
Rutgers Law School and was admitted to bevb Brooklyn Law 
school and St. John's Law School. Student A registered at St. 
John's Law School for the class commencing in the fall of 1976. 
STUDENT B 

Student B, a major in social work at use University, 

with a GPA of 2.27, took the LSAT in July 1973 scoring 518 
and in December 1974 ing 511. Student B then applied 

to Fordham Law School .or the class entering in the fall 
of 1975 and was rejected. 

Student 3 then enrolled in John Sexton's LSAT Preparation 
center prior to the October 1975 LSAT and received a score of 
616 on the October 197 5 LSAT. 

Student B then applied to Fordham Law School, Temple Law 
school, American University Law School, and George Washington 

University Law School. 

Student B was admitted to Fordham, Temple, and American 
university Law Schools and enrolled at Fordham Law School 
for the class commencing in the fall of 1976. 
STUDENT C 

Student C, a history major at McGill University, with 
no reported GPA, took John Sexton's LSAT Preparation Center 
course in New York prior to the July 1975 LSAT but did not 
take the LSAT until October 1975. Student C scored a 480 on 
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the October 1975 LSAT and a 516 on the February 1976 LSAT. 
Student C ^id not apply to any law schools for the class 
entering in the fall of 1976. 

Student C was coached at the Stanley H. Kaplan Educational 
Center in New York prior to the December 1976 LSAT and 
received a score of 632 on that exam. Student C then applied 
to 18* law schools for admission to the class commencing in the 
fall of 1D77. 

Student C was accepted at Fordham Law School, Syracuse 
Law School and at the University of Pittsburgh Law School where 
Student C enrolled. 
STUDENT D 

Student D was a psychology major at the John Jay College 
of Criminal Justice with a CPA of 2.88. Student D enrolled in 
John Sexton's LSAT Preparation Center course for the December 
1975 LS/.T but did not take the LSAT until February 1976. 
Student D received a 437 on that exam. 

Student D applied to Brooklyn Law School, New York Law 
School, New York University Law School, St. John's Law School, 
Fordham Law Sc. .1 and Pace University Law School for the 
class entering in the fall of 1976. Student D received no 
acceptances . 

Student D then enrolled simultaneously at John Sexton's 
LSAT Preparation Center and the Law Boards Institute prior 
to the July 1976 LSAT. Student D scored 581 on the July 
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1976 LSAT. Student D reapplied to New York L*w School, St. 
John's Law School and Pace Law School. Student D was admitted 
to Pace for the class commencing in the fall of 1977. 

STODENT E 

Student E, a political science major at Wellesley College, 
with a GPA of 2.82, took the LSAT in October 1974 and December 
1974 receiving scores of 402 and 424 respectively. Student E 
applied to 8 law schools for admission to the class commencing 
in the fall of 1975 and was rejected by all. Two of the 
schools where Student E was rejected were Georgetown 
University Law School and New York University Law School. 

Student E enrolled in John Sexton's LSAT Preparation 
Center course prior to the December 1975 LSAT and receiv^^d a 
score of 503 on the December 1975 LSAT. Student E then applied 
to 8 law schools including New York University and again was 

rejected by all 8. 

Student E enrolled in the Stanley H. Kaplan Educatio.Ml 
center prior to the October 1976 LSAT. Student E took the 
December 1976 LSAT and February 1977 LSAT scoring 529 end E>27 
respectively. Student E then applied to 13 law schools. 
Student E was accepted at Rutgers Law School, Georccto,:n 
university Law School, and New York University Law School f r 
the class corn-fencing in the fall of 1977. Student E 
registered at New York University Law School. 
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STODENT P 

Student P, an english major at Manhattan College, with a 
CPA of 3.26, took the LSAT in December 1974 and February 1975 
scoring 512 and 518 respectively. Student F then applied to 
5 law schools for admission to the class commencing in the 
fall of 1975 and received no acceptances. 

Student F retook the LSAT in December 1975 receiving a 
score of 530 but made no applications to law school for the 
class entering in the fall of 197S. 

Student F enrolled in John Sexton's LSAT Preparation 
Center course prior to the October 1976 LSAT. Student F scored 
582 on that exam. Student F then applied to 5 law schools for 
admission to the class commencing in the fall. of 1977 and was 
accepted at Pace University Law School. 
STUDENT G 

Student G, an economics major at Queens College, with a 
GPA of 3.18, took the LSAT in April 1975 and scored 536. 
Student G applied to St. Johns University Law School and 
was not accepted. 

Student G then enrolled at John Sexton's LSAT 
'.'repjacation Center prior to the July 1976 LSAT but did not 
t«kC' the e/am. Student G next enrolled in the Stanley H. 
Kaplan Educational Center prior to the December 1976 LSAT 
on whxcb .'t ident G scored 649. Student G then applied 
to 8 law scnools ior the class commencing in the fall of 
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1977. Student G was accepted at 7 of these law schools 
and enrolled at St. John's University. 

S'fODSNT H 

Student H, a psychology major at Brooklyn College, with -a 
GPA of 3.54, took the LSAT in December 1974, scoring 496. 
Student H applied to three law schools for the class 
commencing in the fall of 1975 and received no acceptances. 

Student H enrolled in the Stanley H. Kaplan Educational 
Center prior to the October 1976 LSAT. Student H scored 621 
on the October 1976 LSAT and applied to 8 lew schools. 
Student H was rejected by 3 of these schools (Hofstra, 
Fordham, and New York University). However Student H was 
accepted at Brooklyn Law School, New York Law School, St. 
John's University Law Schr 1, SUNY at Buffalo Law School and 
Rutgers Law School. 

Student H tegistered at Rutgers Law School for classes 
commencing in the fall of 1977. 
STUDENT I_ 

S^^^u'lent I, a sociology major at Hofstra University, with 
a GPA of 2.99, took the LSAT in December 1974 and February 1975 
scoring 514 a..d 424 respectively. Student I applied to 8 law 
schools for admission to the class commencing in the fall of 
1975 and was rejected by al ' . One of these schools was New 
York Law School . 
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■student I enrolled in the Stanley H. Kaplan Educational 
Ceriter prior to the July 1975 LSAT. Student I took the July 
1975 LSAT scoring 549 and the October 1975 LSAT scoring 590. 

Student I applied to 2 law schools for the class 
commencing in the fall of 1976. • Student I was accepted at New 
York Law School. 
STUDENT J 

Student J, a philosophy major at Harvard University, with 
a GPA of 2.98, took the LSAT in July 1974 and December 1974 
receiving scoi^es of 560 and 573 respectively. 

Student J applied to 7 law schools (New York University, 
University of Pennsylvania, Cornell, Harvard, Fordham, 
Georgetown, and University of V_rginia) for the class com- 
(T^encing in the fall of 1975. Student J was rejected at all 7. 

Student J enrolled in the Stanley H. Kaplan Educational 
C^;,.tfti: :n New York prior to the October 1975 LSAT. Student 
J sci-t:'^. 618 on that exam. 

Student J then applied to 15 law schools tor the class 
commencing in ti^e fall of 1976. Student J was place-? on two 
waiting lists (Fordham a.-^d Rutgers) and was accepted at The 
Benjamin Cardozo School of Law. 
STUDENT K 

Student K, an economics major at Fordham, with a GPA of 
3.15, took the LSAT in December 1974 and February 1975 scoring 
482 and 518 respectively. Student K applied to 5 1^-^ schools 
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for the class ent«'-^-7 the fall of 1975 and was rejected by 
all 5 including New York Law School and Seton Ball University 
Law School. 

Student K enrolled in John Sexton's LSAT Preparation 
Center prior to taking the December 1975 LSAT. Student K 
scored 569 on that exam. 

Student K then proceeded to apply to 4 law schools for 
admission to the class commencing in the fall of 1976. 
Student K was admitted to two of these schools. New York Law 
School and Seton Hall University Law School. 
STUDENT L 

Student L, a social sciences major at Seton Hall Univers- 
ity, with a grade point average of 2.79, took the LSAT in April 
1973, December 1974, and February 1975. Student L received 
scores of 482, 430, and 429 respectively. 

Student L made 6 applications for the law schoc class 
entering in the fall of 1975. Student L made 7 applications 
for the law school class entering in the fall of 1976. All 
13 of these applications were rejected. 

Prior to the October 1975 LSAT Student L wa« coached by 
the Law School Admission Test Review Course (Evergreen). 
Mysteriously, Student L did not tak-J the LSAT until December 
1976, scoring 586. Student L applied tc six lav/ schools 
for the cU«=S5 entering in the fall of 1977 af:-^ was accepted 
at the Internationa' School of Law. 
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STODENT M 

Student M, a business major with a 3.42 GPA at Saint 
Bernard College (Alabama) , took the LSAT in October 1974 and 
December 1974 scoring 239 and 286 respectively. 

Student M applied to eleven law schools, including 
Deleware Law School, for the class entering in the fall of 
1975.* Student M was rejected by all these law schools. 

Student M enrolled in the Evergreen LSAT Review course 
prior to the October 1975 LSAT but did not take the LSAT until 
December 1976. Student H scored 477 on the December 1976 
LSAT. Student M applied only to Deleware Law School for the 
class entering in the fall of 1977 and was accepted. 
STUDENT N 

Student N, a history major at Indiana University with 
3 2.68 GPA, took the LSAT in December 1972 and February 197^^ 
scoring 391 and 444 respectively. 

Student N applied to Chicago-Kent College of Law, John 
Marshall Law School, and Depaul University Law School for 
admission to the class commencing in the fall of 1975. 
Student N was rejected by all three schools. 

Prior to the December 1976 LSAT, Student N vas coached at 
the Amity Review Course in Chicago. Student N scored 534 
on the December 1976 LSAT and applied to 5 law schools for 
admission to the class commencing in the fall of 1977. 
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Although rejected by Depaul and Chicago-Kent, Student 
N was accepted at the John Marshall Law School. 
STUDENT O 

Student 0, a political science major at Valparaiso 
university (Indiana), with a 3.18 GPA, took the LSAT in October 
1975 and December 1976 scoring 474 and 424 respectively. 

Student 0 applied to Valparaiso University Law School and 
Loyola university Law School of Chicago for the class commenc- 
ing in the fall of 1976. Student 0 was rejected by both of 
these schools. 

Student 0 then enrolled at Test Prep in Chicago prior to 
the December 1976 LSAT. Student 0 took the February 1977 

LSAT scoring 517. 

Student 0, although rejected Valparaiso University Law 
School and John Marshall Law School for the class entering in 
the fall of 1977, WdS accepted at Lewis University Law 
School, Loyola University Law School (New Orleans), and 
Hamline University School of Law. 
STUDENT P 

Student P, a psychology major at University of California 
at Los Angeles (UCLA), with a GPA of 3.30, took the December 

1975 LSAT scoring 591. 

Student P applied to UCLA Law School and Harvard Law 
school and was not admitted by either, for the class com- 
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mencing in the fall of 1976. Student P then simultaneous- 
ly- enrolled in both the Stanley H. Kaplan Educational Center 
end the Amity Review Course in Los Angeles prior to the 

December 1976 LSAT. 

Student P scored 712 on the December 1976 LSAT and 
applied to 10 law schools for admission to the class commenc- 
ing in the fall of 1977. Although again rejected at UCLA and 
Harvard, Student P was accepted at the University of San Diego 
Law School and the University of California at Davis where 
Student P enrolled. 
STUDENT Q 

Student Q, a biology major at UCLA with a GPA of 3.08, 
^ook the LSAT in July 1974 and December 1974, scoring 438 and 
479 respectively. 

Student Q applied to 6 law schools for admission to the 
class commencing in the fall of 1975. Student Q was rejected 
by all 6 schools. 

Student Q enrolled in the Law School Admissior Test 
Review Course (Evergreen) in Los Angeles prior to the October 
1975 LSAT. Student Q scored 529 on the October 1975 LSAT. 

Student Q then applied to 3 law schools for admission to 
the class commencing in the fall of 1976. Although rejected 
at Loyola University (Los An^el^-K- Student Q was accepted at 
both southwestern University Law School, and Whittier Colleg^^ 
- Beverly School cf Law. 
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IX. ACTS AND PRACTICES OF COACHING SCHOOLS 
All coaching schools make claims or have mad* claims 
regarding their ability to improve scores on standardized 
admission examinations. Some claims are blatant, others 
are subtle. However, they all have the same purpose— to 
convey to the student (or parents of students) that taking 
a coaching course will increase an individual's score on an 
examination that may well be the mo«t important examination 
that person ever takes. 

These clainss appear in national newspapers of general 
circulation, in college and high school newspapers, 66/ in 
posters hanging on campus bulletin boards, in radio advertise- 
ments, in brochures distributed to students and parents, in 
mailed circulars, in speeches, and in such other diverse 
places as bowling alley score sheets .67/ 

A representative sample of claims made by the coaching 

schools, and the coaching school making each claim follows: 

thousands have earned increases of a hundred points or 
more in their scores 68/ 

Stanley H. Kaplan Educational Center 



66/ See generally. Category III File 772 3000, Vol. 1x1, 

^ p. 51-61, for a sampling of newspaper advertisements. 

67/ ^-*egory III File 762 3033, Vol. IV, p. 50. 

68/ dory III File 762 3033, Vol. I, p.l. 
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most effective course available 

the resulting competence and confidence will allow you 
to perform at your maximum potential 6^/ 

Stanley H. Kaplan Educational Center 

from the reports we have received we have found there 
is an average increase of 50 to 100 points for test 
repeaters 70 / 

Stanley H. Kaplan Educational Center 

...achieved such dramatic results that many national 
magazines have written articles about our success 71/ 

Stanley H. Kaplan Educational Center 

we teach twice as many students as any other course in 
the metropolitan New York/'iew Jersey area 72/ 

John Sexton's LSAT Preparation Center 

The LSAT Preparation Center is the only institution 
devoting its attention exclusively to the LSAT 73/ 

John Sexton's LSAT Preparation Center 

the scores of many of our students have jumped 250 points 
or more 74 / 

John Sexton's LSAT Preparation Center 



69/ Category III File 762 3033, Vol. I, p.9. 

70/ Category III File 762 3033, Vol. I of Investigational 

— Hearing Exhibits, Exhibit 5. This statement was made 

in a speech by a representative of the Stanley H. Kaplan 
Educational Centers, Ltd. to the Black American Law 
Students Association of George Washington University. 

71/ Category III File 762 3033, Vol. IV, p. 42. 
72/ Category III File 772 3000, Vol. XV, p. 21. 

73/ Category III File 772 3000, John Sexton Physical 

— Exhibit C, p. 4. 

74/ Id. at 12. 
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the average score of its students greatly exceeds the 
national, median ?5 / 

John Sexton's LSAT Preparation Center 

the average score of our students is one-third higher 
than the national average 76 / 

John Sexton's LSAT Preparation Center 

the median increase for our students who have previous 
scores is over 100 points 77/ 

John Sexton's LSAT Preparation Center 

no other course can demonstrate better results than 
ours 78 / 

Evergreen LSAT Review Course 

thousands of successful students prove we significantly 
increase scores 79 / 

Evergreen LSAT Review Course 

since 1968 we've hei ^d over 10,000 students gain admis- 
sion to law schooj Sy. 

jrgreen LSAT Review Course 

October LSAT average tot those taking the course was 
630 81/ 

LSAT Review Course of Massachusetts 



75/ Id, at 13, 

76/ Id, 

77/ Id- 

78/ Category III File 772 3000, Vol, XLIX, p-131, 

79/ Id, at 132, 

80/ Id, at 134- 

81/ Category III File 772 3000, Vol, LIII, p,37. 
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Follow-ups show that our average student increases his 
LSAT score over 80 points with some achieving a nearly 
200 point increase, demonstrating the course's capacity 
for enabling you to maximize your score within your 
ability 82/ 

Law Board Review Course 

.it will add crucial points to your test scores 
THE POINTS THAT MAY WELL GET YOU OVER THE THRESHOLD 
OF SUCCESS 83/ 

Columbia Test Preparation Institute 

the average increase of students *'ho take out course is 
80 points with some improving as much as 150 points 84/ 

Rutgers Review Course 

if an ave*-age improvement of 30 points results mere- 
iCfroShaving taken the test before, a still greater 
icore advantaie would be expected to follow an effective 
instructional program... ^/ 

Amity LSAT Review 

...the LSAT METHOD can help you make your first LSAT 
score your best score. 86/ 

LSAT Method 

the Seminar equips the law school candidate wi'.h test 
Sking skills essential for maximizing performance on 

the LSAT 87/ „ . 

— Western States Review 



82/ 


Category 


III 


File 


772 


3000, 


Vol. 


XXVII, p. 115. 


11/ 
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File 


772 


3000, 


Vol. 


XLVI, p.. 117. 


84/ 


Category 
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File 


772 


3000, 


Vol. 


XXVI, p. 16. 


M/ 
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772 


3000, 


Vol. 


XXXII, p. 117. 


86/ 
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772 


3000, 


Vol. 


LIV, p. 42. 


87/ 


Category 
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File 


772 


3000, 


Vol. 


XXXIV, p. 99. 



173 



'.V/ 



Even If the coaching schools made no advertising claims 
their corporate names are implicit if not explicit representa- 
tions that they serve some affirmative benefit in preparation 
for standardized admission examinations. 

The use of the words "coach", "cram", "review", "educate", 
-ptepare', and words of similar import convey to the person 
perceiving them that test takers will achieve some affirmative 
benefit by attending the course. This is corroborated by con- 
sumer testimony, the testimony of coaching school proprietors, 
and the perceptions of guidance counsellors and educatois. 

The coaching schools' claims are not limited to effective- 
ness in raising scores. The schools claim to have superior 
curricula, 88/ small class sizes, 89/ experienced faculty wh- 
have scored high on standardized examinations, 90/ and exten- 
sive classroom and homework materials that are continuously 
updated to match the most recent standardized examinations. 91/ 
These claims are of course all ancillary to the claim of 
effectiveness in increasing score. 



88/ Category III File 772 3000, Vol. XLIX, p. 131 

89/ Category III File 772 3000, Vol. XXXII, p. 99. 

90/ Category III File 772 3000, John Sexton Physical 

— Exhibit C, p. 8, 16-17. 

91/ Category III File 762 3033, Vol. I, p.l. 
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